ED X86 8-46 ^' CS 305 • 



AUTtiOh Jouason, i^a^tj u,-i And ot.htirs^ * ' . 

T^i'Li. A Nei.' Appi^oacii tD the Assessiue^iC of "Phonics 

, , • .1 .. ; ' 

ION , «i*,i5consiii U ux v. ,^^Ji soii, • Research and DeveiopMfent 
. ' Cw-nter lor ^aaiviaual laed Schooling^ . 

ol'ONi AoiNClf -.Ndtionai iast. oi Kdacation (DHEK) , Washinqton, 

PUU DAI.E \ jec 79 , 



NOTE 



DEi^cHlfjOr.i Btt^^iLain^ K&edin^; Elementary Education: Error 

Patterns; *^>honi^as; Primary Education: '^Heading ' 
w*agnos*s; ^'aead-n^g Eeseatch; ^Reading Tests: *Iest 
*wOastr action ; Ltjst Items 

aoLK -on the dtVtexopaent of a" j^ho&ics test that will v 
^Ofc -^L.cozt'Oza.t^a. into a tota-t woia -laentif ication test^ battery ha*. ^ . ■ \' 
V'o:;ti;,\it,-a lor sevHrai yearai.' -A prototype ot the test Wa.s -de-veiops^ -i^r/ ^ . 
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«« Abstract* * 

- ^^^^^ « 

^^..^ ... r ■ * - ' - , ^, 

The research discussed in this report .continues an effort to 
identify subskills of word identification which correlate highly with 
reading comprehension and to develop empirically based instruments 
to assess these subskills. 

A prototype of the Phonics Test was developed in winter 1977 

and a revised version was administered in spring 1978; Analyses of ^ 
*■ 

the test data revealed several problems inherent in the instrument. 

As a result^ the criteria which had guided test construction were 

evaluated, and new criteria were established for developing the 

present test. In addition a survey of the phonics components of 

nine popularly used diagnostic and achievement tests, was "conducted in 

an effort to identify any existing phonics instrument that would 

meet the established criteria. The survey revealed there is no 

instrument currently available that takes into consideration all of 

the 'Criteria essential to. phonics assessments Therefore, a new test 

t 

was designed to meet these criteria. * 

•The new Phonics Test "assesses 45 different sp^lling*to-seund 
correspondences in 141 items. The test is 'comprised of t^6 subtests: 
A Consonants Subtest which assesses 25 correspondences (single-letter 
consonants ♦ co isonant clusters, and consonant digraphs);* and a Vowels 
Subtest which assesses .20 correspondences (long vowels # short vowels # 
and vowel clusters). 

The Consonants dSibtest wa!3 administered in winter 1979 to 187 
third, fourth, and fifth grade students. A randqjnly selected s\absample 



of 59 students a^so .participated in an oral reading task, to establish 
concurrent validity for the new test*. Results of this study indicated 
that by third grade , chi Idren^^fc^vs ^mstftreH most of THe frequently 
Qccurring letter-soui>d correaplmdences in our language. When children 
did make errors, they usually made them on either consonant digraphs 
or on the three single-'letter consonants which have other common . 
sound correspondences (c, 2L' i) • 

The Vjowels Subtest was administered in spring* 1979- to 190 third, 

fourth, arid fifth grade students. A randomly selected subsamgle of 

' ' • / I " ' * ■ ■■ ^ ■ 

42 students also participated in an oral reading task^ The results 

of the -study indicated that, overall,* performance was highest on 

vowel cluster's, next highest orf long vowels, and; lowest on short 

' «• 

vowels. The most interesting result of the study ,^ however # was when 
children did mke errors, they appeared to have^been strategic in thpir 

V. ^ . "Our 3 • / 

responses • Most children who chose an incorrect response choice tended 
to select the response choice that had the long vowel counterpart to 
the short vowel in the target correspondence (or vice versa) . In the 
case of vowel cluste^rs, students tended to select the response choice 
that had the sound of one of the two letters of tlie target cluster. 

Th? item analyses from the winter and spting 1979 Phonics Test h 
raised some interesting speculations about the nature of phonics 
processing^ Plans are being mc*-* to further revise the Phonics" Test 
and to administer the new instru -snt in winte? 1979-80 • To make the 

• . ' -i r . , A , 

revised instrument more global, a greater number of Ifetter-souna 



correspondences will be assessed • Also, because performince on th2% 
Consonant^ Subtest and the Vowels Subtest was extremely high, younger 



XIX 



stude.^ts .(second and third gradefs) will participate in the winter, 
i979-"80 test administration, * , - 



• Thp fina\ version of tba Phonics Test will be incoa^porated into 

a total Word JCdentification Test batter?. We expect that the infor- 

* ■■ ' 

mation gained through^ the administration of this bfbtery will pre", lie 
educators with insights about the i:eiationships of the various compo- 
nents o^f wor^ identification to comprehension, . This knowledge will 
have it^ ultimate benefit in the cla4sroom,\l>V providing tethers " 

with a valid and reliable instrument for assessing reading skills and 

* * 

for planning reading instruction^. ^ 
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The focus of the research conducted over the' last 3 years by the 



Project on Identification and Assessment of Com^ne^ts of R#ading 
Comprehension has been to iX)^ explore the relationships among word 
identification skills ^nd comprehension abilitiesr C2; determine to 
what degree and in what ways the mastery of skills relates to readihg^ 
comprehension,, and (3) identify those skills which appe.ir to relate 
luost closely to the comprei\ension of::wra^tten language* , ' ; 

Q^cause mji^ch of^the current" infoanhat^on concerning word identi- 
fication and comfjrehension is based on speculation only, an empiricari 
'examination of these issues is clearly needed* A primary goal of* the 
Projects therefore, has been to investigate the possible relationships 
among word identification skills and re . *^xig comprehension, and to 
ascertain how these skills ^tiight be assessed roost efficiently n 

Beginning in winter 19,77, a, test battery was developed to assess 

skills in the* threes b .c^d areais of word identification: phonics, 

■ ■» 

structure, and^ context. ^ During ^sprlr^g 1978, the Project-developed 
Word"^ IdentlficatijDn Test battery, and the* reading subtest the 
Metropolitan Achievement Tests {Durost, Bixler, Wrightstone* Prescott^ 
& Balow, 1970), w^ere administered to ov.er 1,400 public elementoiry 
school children in grades two, four, and six from five i^egions of 



the country (Johnson, Pitte.lman, Schwenker, Shribeirg, ^ Morgan- Jan ty , 
. 1978). The Phonics component consisted of two s-ubtests: a ZO-item 
Consonants Subtest and a 207item Vowels Subtest. For eac^.-item, a 
target synthetic * word appeared in a box and* had one, two, or three 



letters underlined. The children's task was to circle the c<»rr^ct 



snse .(out of three roal-word choices) "whose underlined pairt 
sound [fedl just Ixke the underlined part of the word in the box." 

Subsequent 'data analyses revealed poor' item-subtest reliability 
for iteinf? where (J.) single*^let:^r <^bnsonants and consonant digraphs 
were tested in the medial position in words,? (2.) medial vowels were 
tested in words ending with liquids (r or 1) ; (3; similar vowel - 
sounds in words could be -percei-ved as the same vowel soxind by, users 
of diff«vrt?»^^dial\pts; and (4) the underlined part of a "target syn- 
thetic word had a di-ffarent word position Ci^e,, initial^ medial,, or: 

filial) *from the underlined part of one more response choices. The 

. _ ^ . \_ ^ ....... , ^ . ■ ^ - . - ...... ^. . 

spring 19-78 Phonics Test also fe-11 short on validity measures^ 

/ ' • * ^ 
especially because it did not control for the Visual matching of 

letters as a basis ^r selecting a response choice • Plans were riade^ 

therefore, to redevelop the Phonics Test and to administer the revised 

test to new populations of ole^jaentary school children. 

V 

Several issues have to be considered in the development of a 
pilonics instrument.^ First, the scope of the test has to be addressed; 
that is, a decision fias to be made as to which of the hundreds of 
spelling- to-sound correspondences in our language should be selected 
for assessment • Next,^the format of the test has to be considered • 
It is important that tl^e test mirror the reading process as closely 
as possible, requiring children to use a decoding (from letter to 
sound), rather than an encoding (from sound* to' spelling) process • 
While -^n individually administered productive task would best reflect 
the reading process, co^ideration must ^^5e^giV^ to efficiency of 
assessment. Finally, the modes in which thej^arget spelling -to -sound 



corresix:>ndences and the response choices aro presented must be deter- 
mined. . ' 

. In a phonics assessment instrument p there are several ways to 
present the target letter-sound correspondences in a decoding trather 
than an encoding) format. The target stimul^us could be the letter (s) 
in isolation, or the target stimulus could presented within a 
real word or a synthetic word. Similarly, there are several consider- 
ations involved in developing the response choices. One concern would 
be the number of response choices; too few \s:ould reduce the reliability 
of the test.^d too many would make the test unwieldy. A second 
consideration is the mode in which the response choices appear: isolated 
letter (s), words^ or i>ictures« If the response choj.ce is a word or 
picture,^ attention must. be give^'to the position of the targeted 
sound within the word or picture name (beginning, medial, or final), , 
and to the number of syllables (one oi^ moire) that; make up that word^ 
A survey of the phonics components of popularly used tests was 
conducted Un light of the above issues. The* following diagnostic and 
achievement tests were examined: the California Achievement Tests 
(McGraw-Hill, 1977), the Bote 1, Reading Inventory (Botel, ^1961) , the 
Prescriptive -R^ading^ Inventory (McGraw-Hill, 1972, 1976), the Skills 
Monitoring System for Reading and Word Identification (Harcourt ^race 
Jovanovich, Inc», 1975), the Wisconsin Design for Reading Skill 
Development (Otto, .Miles, Kazran, & Stewart, 1972), the Phonics Knowledge 
Survey (Durkin & Meshover, 1964), the California Phonics Survey 
(Brown & Cottrell, 1963), the Stanford Achievement Test (Madden, 
Gardner, Rudman, Karlsen, & Merwin, 1970-1974), and the Silent Reading 



Diagnostic Tests ^Bond, Balow, & Hoyt, 197^^. 

Many of the tests surveyed assess only agnail number of the*, 
many correspgndences in* our .language The California Achievement' ^ 
Tests, for example, consist of only 25 itemg; 10^ items assess tjtie 



V 



entire Consonants category (single-letter consonants, consonsuit*' 
digraphs, *and consonant (ilu^ters) , 13 iten^ assess single-le?tej: 

c * ^ ■ 

vowels (all either long or short) , and 2 items astsess vowel clusters 
' or diphthongs. The Prescriptive Reading Inventory and the Phonics* 
Knowledge^ Survey,^ 6oth diagnostic ♦tests also have relatively few 
items which form the basis for global jvidgnfents regarding chil^<SScen * s . 
overall competence w^th phonics* * 

• In addition to the number of correspondences assessed, attention 
mu6t be focused on how often- those^lcorresjpondences occur our language 
I According to the frequency data for the spelling-td-sound' correspond 
dences ifi the 20,000 mo^ conunon English words {Venezky, Note l) many 

, r • ' ■ 

of the tests we jre^xewed assessed correspondences that have low fre- 
quencies of occurrence." The California Achievement Tests, the Pre- 
scriptive Reading Inventory ^ and tj|e Wisconsin Design all include a 
sizeable number of items that assess correspondences which appear 
rolativa>iy infrequently in our language • Moreover, a large number 
^ of correspondences are not assessed in the E>osition(s) which they 
most typically occur in English words* The Wisconsin Design, for 

it.* 

example, assesses the single letter v in final word pqsition* Data 
from the VenezHy tabulations indicate that v appears only twice in 
•7 fi^al position in the 20,000 most common English words* One has.to^ 
consider, therefore, whether it is ^educationally prudent to asis^ss v 



as /v/ ill final positioai* 

Clear l^^^he most accurate procedu by which to assess phonics 
skills is by means of a productive task. The ideal phonics test 
would require that the child read aloud, ' while the examiner records 
all pronunciation errors made on unfamiliar rwords. The Phonics Know- 
lodge Survey is an example of a prqjJuctive test, althougn^ it uses 

letters instead of words. * Children view se)s|itately each of 14 con- 

' . ^ ■ ^' , ' ' ■ ' ' 

sonants and the 5 single-lett:er vowels; they are then asked to pro-' 

■ ; 

aounce the correspohdxng sounds for the consonant letters^ and the ^ 

■ ^ . - - ■ " v> - ^- 

3 ionq and 5 short corresponding sounds foy the vowel" letters. 

This- productive method of assessment is. not efficient, however ^^ bilcause 

of the time neede<| for testing each child individually. In addition 

tu the prob3?ems involved with the prqcediire% the validity of assessing 

letter-sQund'Qorrespondence's in isolation^ rather than within the 
• 'I 

r 

context of words is also questionable* 

The Botel Reading Inventory, also i productive test, utilizes 
a written format which can be administered to a large ^group or clas^. ^ 
Unfortunat^^t however, ^ some of the tasks on the Botel^may not be ^ ^^'4 
appropriate for all the. children for whom it/ is intended. Level B, 
for example, requires children to write a two-letter diphthong that , 
has the same sound as a giv.en single-letteir vox-^el — a rather sophisti- . 
bated task for primary-level pupils. Moreover, the Botel involves . ' 
encoding as well as decoding processes. 

Another issue central to the construction of an effective phonics 
instwraent is the mode of presentation of the letter-3ound cotrespon- 
dences being assessed. The letters/ for a cprrespondence can be 



presented in isolation, in real target worda, ar in syj^ttJietic t^ryet 
words The value of assessing the sounds of letters in isolation^ 
howeva*^ is questionable^ l^cause the sounds. o£ many letters^ especially 



vowels, are dej:ennined. by their orthograpjiic eiflPl^onments . 
' \ 

.One alternative to assessing letters in isolation is to present 

the target betters within a real word* But the problem inherent in 

• using real words' is 'that children niay recognize the v^ords as sight 

words, and therefore might not need to utilise a decoding strategy ♦ 

-The Skills >tonitoring-^^s tarn- for Reading, and ^Mord IdentificatLxonf for 

example, assesses the lel:ter-sound correspondence for ch as it appears 

in the real Vord each* The four response choipes are dish^» Christmas/. ^ 

^ ^ . . , 

anchor, and chair . Because all four response choices i^lude a<5curate 
pronunciations for ch, children must rely wT^'ior knowledge of the 
pronunciaC?6ns .of the target word and response choices to arrive at 



the correct answer. This implies that children H\ust recognize these 



words as sight words, and.tlie procesvS is then one of auditory matching 
rather than of decoding. ' . 

A second alternative is to present the target 'letters for a- 
correspondence within a synthetic word. This format allows letter-*- 

. • - • ' • V 

sound correspondencQte to be, presented within appropriate orthographic 

■ % • 

environments, and requifefe that children use phpnics (decoding) skills^ 

rather than a sight word appHtoacfi, to arrive at correct answers.* One 

cgwicern with the use of synthetic^ target wotds^ hpwa^er, is ensuring' 

that the synthetic words conform to phonological principles of |the 

Eriglish .langxiage. In the tests surveyed,, the synthetic' words were not 
% 

« ; 

alvays phonological ly acctjrate. For example, ^in the Phon^ljs Knowledge 
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Survey > childreft arc asked to proncrfuhcfe <.the sound made by the a in the 
synthetic target word, aef > The correct answer xs given as long a^ 
because children are expected to apply. the "rule" that "when two vbwels 
are together, the first vowel- says its name and the second vowel is 
silent. According to Venezky (1970), however,^ ae^ in initial position/ 
is never, pronounced ..as long a* , * 

^en creating a phonics test, it is also irl^rtant that, eyeful 
attention given to the aevelopment of the response choices; •One 
area <Jrf concern is the number of response choicq^ because this can 



affect the reliability^ of the test. Many of the t^sts surveyed nadx"^ 
, true-^false, same-different, .or yes*no foVmats,^. which greatly increase 

the likelihood of guessing correct answers/ Most of the te^ts, however, 

> - 

had a multiple choice format^ with the number of response choices 
varying from three to five. ' - c 

A second consideration affecti^ng the development of respon&e 
iioices is tlje number of syllables in words. Many of the. tests were 
no|L consistent in controlling for the number of syllables in the 
N^espojis^ choices within an item. The Wisconsin Design, tije Skills * 
Monito^ihg System ^for Reading and Word Identification, and the Stanford 

• ' 4 ' ■ ' ■ ^ ■ 

Achievespent Test, for example, all include response choices with 
vailing numbers of sylf^bles. ,.In this j;egard, educatprs have ©Kpresifeed 

\ ^ i.- ^ 

concerp that decoding a multisyllable word may reqtSlre different 

^ . . . - c 

underlying skills than decoding a one-^syllaUDle word, and that including • 
both kinds of words \j7ithin a given test item may ^oHfuse y&ung> chil^ec ^ 
; The California Phonics Survey contains many items wittt- multisyllable 
and oi^ie-syllable words, but because this^t^st was developed for 
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secondary and college level pupilsr this issue is of lesser^ conceir;i 

herfe ... " 

• « » 

J A third issue has to do with the position of the target letters 
' . . V ^- . 

'G4- the correspondence within a word (initial, medial, or final) . 

* *• 
According to Vene^ky (Note 1), the position (s) . of greatest occurrences. 

v^aries^for different letters: it ^eems logical/, therefore, to assess 

a letter-sound correspondence in the word positionNwhere' it 9K>st 

frequently ocQurs, The">qsitionf pf the target letters within a target 

wprd should also match t;he position ct the foil correspondences within 

* - . - 

each of the response choices. The Stanford, Achievement*^ Test, the , 

■ ■ -;■ . - • ■ ■ . V - J 

Skills Monitoring System for Raadi^^g anc*. Word Identification, and the 



System for ^^R^adi^ng anC 



Prescriptive Readin^Inventory, * include items, that contain shifts in 
the word position of target correspondences* The Prescriptive Reading 
Inventory^ for 'fexample, has an item in ^hich sho3ft ^ is presented in 
medial position of the CVC word, cat . One of the resQ^se chqices is 
the cy word, day , which has its vowel sound in final position* Asking 
young children to perfoip these word position shifts may require a; 
differerirt: psychological brocess thifn the one used when target corres-- - 

\ ■ ■ . \ • . ^ ■ • . • ■ ' 

pond^nces are a^ in the pame position within words* ^ 

A fourth "issue- related to the developn\ent of response choices is 
thfc nvDde in vfhich these te^?onse choices appear . All but two of the - 
tests -reviewed (the Phonics Knowl^^e Survey and the Botel Reading 
Inventory are productive tests) . nclude response choices in the form 
of isolated^ sir^le letters or ;tetter clusters, real words, or pic,tures. 
The validity of utili^sing ,singlie-letter or letter cluster response 
choices (as itx; the Prescriptive Readinq^^^ls(iventory and the Silent • 



■ • / .. • ' • • • '• • 

Readinq Diagnostic Tosts) is questionable* In a review of i-he Silent 
Reading Diagnostic' Tests, for example, Kress (1972) refers to the 
response choices as ••artificial graphic representations," and is 
dubious about whether they truly measure the phonics abilities' bein^ 
assessed: -K/ . . in Test 6, for the bee inning sound in natural ^ the 

chxld IS to select £n, from £n, un, tn, ntj in Test 7, for the ending 

» 

spund in decay , he is to select i^uet from khak , kayn , cove , guet ; in 

Tost 8, for the vowel sound at the beginning of the word win, he is " 

^ ^ — 



to select £ from }t, rr v ^ 

•In most of the tests, tlie most common form of response choice is * 
th& real word {the Prescriptive Reading Inventory, the Skills Monitoring 
System for .Reading and Word Identification, the California Phonics 
Survey, the California Achievement Tests » and the Stanford Achievement 
Test) • One of the problems with u^ing real •word response ^hoices is 
the likelihood of testing visual matching, rather than decoding In 
the Stanford AcAievement Test, for example, children are presented with 
the target letter t^.in the real word ten. The three. response choices ^ 

g^^^ ^ nine , and been , Childrey can easily select the correct 
answer by visua:y.y matching the t^ in ten with the t^ in gate . 
^ Of all the tests inspected, the Wisconsin, Design was most consis- 
tent in using response choices in picture form. The use of pictures • 
as response choices eliminates the problems associated with real or 
synthetic words — that is, the visual matching of real words, the 
recognition .Of real words as sight words, and the concern that synthetic 
words may not conform to phonological properties of the English language. 
In the Wisconsin Design, the examiner pronounces the picture names of 



the target word and of all the response choices. The focus of this 

* St 

test, there fore ^ is on the auditory matching of sounds # rather XJian 
on the ci'^coding of letter-sound correspondences. • ' 

It isUpparent from-, the review of existing tests, that a phonics 
instrument" which considers all ttfgi issues discussed above is not 

cuxsreWly available. As a result, the Project on identification and • 

■ ■ ^ 

Assfefs^ment of Components' of leading Comprehension decided ^o revise 
^the spring 10?2 r^-^nics. Itest^ This i^ist was redeveloped to use a 
decoding format and^ to include items fo/ a large number of frequently 

occui9ring spelling- to-sound correspondences • The new test presents 

•*'. 

• *■ 
target corresppndences in synthetic words that are phonologically 

accurate and four response oiftoices in picture form, A format consisting 

of synthetic target wordsa^d pictorial re^onse choices will ensure 

that the test assesses true.^phoni^os Skills,, rather than the visxial 

matching of letter^ and the auditory matching of pounds. 

The revised Phonics Test asse^es 45 different? spelling-to-sound 

/ 

correspondences with ^ total of 141 itemsl The Phogics Test is com- 

' prised of two subtests: a^ Consonants' Subtest , whichr^s composed of 

51 single-^ letter consonant items, 1^5 consonant cluster items, and* 15 
• • . 

consonant digraph items; anci a Vowels Subtest , which is composed of 
15 long vowel items, 15 short vowel interns, and 30 vowel cluster itMis. 
Each spelting-to--sound correspondence, is tested with three or four \ 
items. Selection , of target items was based on frequ^cy data from the 

. I , ' . ■ - . 

Venezky (Mote 1) collection of ..spelliiig-^to-spund correspondences of 
the 20,000 most qommor^ English words* Response choices are based on 
speech production data ^ and perceptual information from- the Boumk (3^71) f 



II 



Miiler and Nicely (1955), ,and Peterson and Barney. (195^) confusion 

* • 

matrix studies* . * 

With a continuing emphasis pn tKe importance of phonics instruc- 
tion in elementary school reading programs < educators are clearly in 
need of an effective instrum«it for assessing phonics. The. goal of • 
thd Pxjbject, then^ is t© develop a phonics test which will ultimately * 
be incorporated into a total word ident^^f icati'on test battery, and 
which will be a, valid and reliable instrument for bpth researchers and 
practitioners in the. field of education. 

... . . . * ^ ' 

• DEVELOPMENT OF THE CONSONANTS' SUBTEST ' . 



The Cdnsonant^ Subtest assesses 25' different spelling-to-sound 
corresi^ndenc^^. Sounds selected for testing were single-^letter 
consonants, consonant clusters i and consonant digraphs. 



Method 

Subjects 

A total of 187 third, foiurth, and fiftlr grade ^pupils frpm the 
Oregon, Wisconsin Public School District participated in * the studies 
(see Table 1)* Third grade pupils wera from loregon elementary School; 
fourth and fifth grade pupils formed a mixed-class unit in Oregon 
Middle School. 6regon is a mi^western rural community with a socio- 
economic level ranging from lower middle to upper middle class ♦ 



Stimuli 

The Consonants Subtest assessed 25 different spelling-to-sound 



Table ; 

m 

Consonants Stibtest; 
Subject Population by School and Grades 
(N = 187) 



Schools and 
ciassrot>xns 



Grade 3 



Grade 4 



Grade 5' 



Cpnso- Oral ^ ' Conso- 
nants . reading ' nants 



Oral Conso- Oral 
reading nants reading 



Subtest tasks ^Subtest ^^tasfcs 'Subtest tasks 



Oregon Elementary School 

■ 

Classroom A 21 

Classroom B 26 

Classroom C 23 

Classroom D 19 



8 
9 
8 
7 



Oregon Middle School 

i 

Classroom A 
' Classroom B 

Classroom C 
. Classroom D 
. Classif^m E 



9 
14 
11 
15 
12 



3 
5 
4 
4 
4 



7 
6 
9 
■ 8 
7 



3 
1 
1 
1 
1 



Totals 



89 



(32) 



61 ' 



(20) 



37 



(7) 



13 



correspondences in 81 items » Each item consisted of a synthetic word 
with the target letter (s) underlined and four response choices ilti 
picture •form. Pupils were instructed to* read the synthetic word to 
themselves and decide the sound of * the underlined letter (s). Next 
they were told to circle the picture in that row which had ^ name 
li^ginning jor ending) with the sound of the underlined letter (s)* 
Figure 1 is a copy of the directions? and practice items from the 



Consonants Subtest. - ..... . . i — i . 

^ Target consonant sounds were selected according to their f requen- 

cies of occurrence in th^ Venezkv (Note 1) corpus of the 20^000 most 

common English words. ^ wOnly thpse spelling-to-sound 9orrespondences 

with total frequencies of 150 or more are included in the Consonants 

Subtest. These correspondences appear^ in one-syllable ^ target synthetic 

words that conform to phonological properties of .the English language. • 

The response choices for each item are four pictures whose names 

are well knovni to elementary school-age' children, l^pr each target item^ 

the four response choice categories are: {15 a Correct response choice, 

(2) an Acoustically Close response choice, (3) a Visually Close response 
« 

'choice, and (4) a Neither Acoustically Close Nor Visually ClSse 
("Neither'^) response choice. (For 12 of the single-letter consonant 

items, this fourth Response choice category was changed to include the 

«• ^ 

second most common ^ound correspondence for, those consonant?*) 



Select'ion of Target Sounds 

single-letter consonants . According to the Venezky (Note 1) 
tabulations all a2 single-letter consonant correspondences have ' 



PHONaCS; Co isananfs 
Initial Position 



A 



In each row, look at the made-up word. N6ti*ce' that ttjete is -a letter 
6r letters* underlined at^tho beginning of that vprd. Read the word 
to yourself and decide how. the." und^ir lined letter or 'le'iters* sound. • 
Then find the picture' in the row whose name begttis with the same * 
soujid as the underlined letter or letters. Draw a circle around that 
picture. ' • . " . » 



A. 



B. 



groon - 



C. 



chilp . 





V •» ... ■ 



I'; 









Fiquro i. The directions and i>ractice .items -from th© first page pf the . 
Conr>onants\Subtest. - . _ 



- . - 15 ^ 

• , * ■ » ■ • 

ftequencies of 150 or more* in th^,. 20,000 inbst common English wrds» , 
These isingle-letter consonant correspondences* were- divide4 AntQ three 
frequency groups and five wQre randomly chosen from each group. The . 

15 sin^jjie-letter consonant '^orrespondehces are listed in Table 2 • . 

■ t . ^ 

Consonant clusters. Sixteen two^letter consonant. clustaJcs were , 
identified as having frequencies of over 150. The following five 



r* consonant clusters were randomly selected? for inclusion in the Phonics 

■ »■ ■ ■ . . ' . ^-.-^ — ^ . .. 

Ttestt s t ,^ tTf ^sp , br , any cl . 

Consonant digraphs . Of -the^even two-letter consonant digraph?, 
Venezky, (Note JL) listed five with frequencies greater, than 150. All 
five wfere selected fur iusion in <;he Phonics Test: shy^ ng / t h 
(voiceless), chr and - 

Single-letter consonants, bortsonaat clusters, and consonant digraphs 
* were 'tested 4ri tile initial or final positions of ^ words, accordiiag'^to 

their frequencies of occurrence in those positions ^s reported i^ the , 
V^nezky tiabulations. Some spelling^to-sound Correspondences were . ' 
tested in initial positioh only, some in final position 'only, "and^some 
in both initial and finii p*osition^.. Consonants, consonant clusters, 

V . , . ^ ^ 

* ' -* 

and consonant di^af?hs were not tested in medial position because (1) 

' ' • * * ■ I , * • * . 

, . I ...... 

'a medidl consonant sound ,would^*- have to Jje assessed in words that exceed'. 



one syllaCble, (2) a medial consonant ^ound might be **masked" by initial 
and final consonant^ sounds , and (3) consonant clustefis* often, lose tnelx 



integrity ^ts^ a cluster' ik the medial position in ,word3.^ (e»g.. , wh?n the 
• word, master # is syllabicated into ma^ and ter , the cluster st becomes 
" final and initial t) • ^ . . • 



V 



Five Single«*Ietter Consonant Correspondences Chosen^ 
from Three J'requency Groups 



Frequency qroup 



Target soimds selected 



2000 - 5000 OCCU3 rences 



700 * 2000 occurrences 



below 700 occurrences 



n, t, d, £ as A/f /s/ 
b, v#*S[ as /g/, c as /s/ 
\£ as /zA as /j/, j^. 




■ ■ ■■ ■ h 
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Selection of Response Choices • • • » 

Each 6t the 81 items in the Consonants S\U>test has 4 response 
choices in picture form: a Correct response choice, an Acoustically 
Close response choice, a Visually Close response choice, and a Neither 
Acoustic axiyS Close Nor Visualdy Close (Neither) response choic^. . 

Correct response choice This response choice is a picture ^ 
whose name contains an initial or final consonant sound that is the 
same as the sound corresponding to the underlined letter (s") in the 
target synthetic word, • 

Acoustically Close response choice ^ This response choice is a. 
picture whose name contains an initial or final consonant sound that 
is acoustically close to the sound corresponding to the iinderlined 
letter (s) in the target synthetic word* Whenever possible, data from 
the Miller and Nicely (1955) confusion matrices were used in selecting 
the acoustically close sound ♦ (The Miller and Nicely study pr^eef^d 
perceptual confusions for 16 consonant singletons under the manipulated 
variables of signal to noise ratio, decibel leveW~-^nd frequency 
response in cycles per second*) For example, one of the test items for 
the spei:^ing-to-sound^^^rrespondence for b as /b/ in initial positioij^ - 
presents the target synthetic word bund. The Miller and Nicely study 
indicated that the sound /jb/ most often confused with the SQunds 
of /fv/ or /f/. The Acoustically Close response choice Jfor this item, 
then, is vest , a picture whose name J^egins with the sound /v/. 
(Another Acoustically Close response choice ftiight have be'en-^foot, be- 
c/uise footi begins with /f/0 * 

The Miller and Nicely study did not provide confusion information 



^18 



. for 5»roei sfngle-letter consonants^ any consonant clusters, or some 
consonant digraphs • Therefore^ speech production data J[Massaro, 1975; 

. Shriberg, Note 2) were also used to constrtict Acoustically Close • 
response choices- (There is evidence to suggest that spuxlds ^pf oduced 
in pjQpximal positions within the oral cavity are more^ls^ely to be 
<i:onfi^sed than sounds produced in more distal positions, .An 

A<;5pustical>L^ Close response choice c&uld therefore be determined 

\- 

from this ItifdrTOationJ ' • . - • — 



Forp^example , for the Varget consonant cluster st .we decided to 

■ ' • - -v. 

jpetaxn the fricative /s/» and to change the /t/ to aether Vpicfeless 

V 

stop (hence: /sp/*or /sk/> . The target s^;^hetic word zoost appears 

in a test item for st > /inal position. The Correct response choice 

is a picture of a nest ^ because nest ends with the sound /st/, the i 

« ■ • . * 

.same sound as the /st/ :.n aoost > The Acoustically Close response 
(jhoice is a picture of a desk , because desk has the soiuid of in 
final position* (Another AcToustlcaliy Close response choice might have 
been a picture off a wasp ^ because wasp ends^ in /sp/^ the other 
Acoustically Close response choice- possibility .for. /st/J 



Bouma^s (1971) confusion matrix study jiff lower case letters were used 



Visually Close response choice ♦ This response choice is a picture 
whose name contains an initial or final letter that is visually close 
to the underlined letter (s) "jln^ the /target syrjthetic word. Data from 

.to create the Vi^lially Close response choices • (Th^^ouma stu4y 
ix>rted confusions made for each of the 26 lower case letters whefC 
presented on a screen in IBM Courier 10 typeface^ 7 degrees from 



5J 



the point of fixation at a distance of 50 cenL^meters. ) To .illustrate 

v < . % 

how the matrix information was used» consider the target letter t_: 

wv ■ • *' ' , ^ 

•puma's confusion matrix indicates that lower case t is most frequently 



confused with lower case, i . In an xteia* that tests the Sound of t in 
initial position, therefore, a Visually Close response choice could 



be a pictvire of a cube of ice, becauseaioe begins with i. 

The Bouroa confusion matrix was not applicable for two-letter-. 



clusters arid digraphs. Instead, a picture was "us^ed whose liame" cbn- 

tained one of the two ^consonants of the. cluster or digraph. .In the 
f ^ ^ ' 

item where st^ is tested in ^f inal position within the target synthetic 
word 2^st; the Visually Close response choice is a picture of a bug , 
tiocause bus.^ends in one of the letter (s) of the two-letter cluster 

^ • — ' V 

N st_. CAnotSier Visually Close response choice could have been a picture 
pf a goat , beca^use goat ends in t, the other of the two letters of the 
cluster .r 

Neither Acoustically Close Nor ^Visually jClose ilNeither) response 
choice . This response choice is a picture whose name has neither a 
•sound that is acoustically close nor letters that are visually close 
to the' underlined letter (s) in the target synthetic word. For example, 
in the item tei^tinq final st in the target synthetic word zoost, the" 
Nci tiller' response category .is a picture of a worm^ ' The final conso- 
nant cluster -m is - neither acoustically close nor visually close to / 
the st in zoost. The response categories were created to see whether 
children unable to decode a target correspondence .would apply an 
auditory strategy (sej^ect the Acoustically Close response choice) , a 



♦visual stratijgy (select the* Visually Close response choic^) , or if they 

* . ' ' 

would merely gu^^s» A disproportionat^e number of incprrect responses 

r 

in the Neither response choice category might indicate a tendency 
toward guessing,. ^ ^ ^ . 

Three single-letter consoQants {£f s, and g.) each have two cc»nmon 
sound correspondences. In. the i-tems assessing these correspbndences , 

. .A ' ■ 

the lieither response ^;'ategorv was. hot always used* The six spelling* ^ 
•to-so\ovd correspondences for these i:hree consonants, and the positions 
in which they were assessed, are: , 



-c as A/ " initial) 



c as /p/ ' , {initial; final with silent e) 

s as /g/ : ^ tilsiitial; final) ^ 



5 /z/ ^ *^ (fii^l) 



2^ as -/g/ ' (initial; final) ' 

2. /i/ (final with silent £) 

For each of the six correspondences above, four items (instead of three) 

were created. Of the four itemsT^two had the responsef categories of 

\ 

Correct, Acoustr^ijilly Close, -Visually Close, and Neither. For the \ 

/ ' ■ * . ' ^ 

remaining two items', a response' choice called Other Comon Sound 

Correspondence was substituted for the 'Neither response choice • This 

new ^"category containjsd a picture whose name began or endecj with the 

other coxTution sound' correspondence- For example, in an item testing 

c as /k/ in- initial position, the target synthet^^^c word is cobe , the 

Correct response choice is a picture of a t:mf f # and the response choice 

ih the Other Common Sound Correspondence category is a picture of a 

saw (the other common sound correspondence for c is /&/) . 
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4 Procedure 



\ 



if was imiK)rtant to ensure th^ the pictures in the Consonajits ^ 
^itibt^t be identified by their designated names « Therefore^ each cla^s 
was gi^n a Picrture, fNan^i^ Exercise prior to the Consonants Subtest ^ 
of the Phonics Test ^r^ Upon completion of the sjobtest, a Random saxaple* 



of students also participated in two oral reading "tasks • 

• PijlLture Naming Exercise, The selection of pictures for the ) 
Picture Naming Exercise vas based on ^ pilot * study*^ inv9lvir>g 
approximately 30 fourth grade pupils. Ail pictures that were incorrectly^ 



labeled^y two or more subjecjts in the pilot study were included in i:he 

Picture Nammg*^ Exercise. - ^ ' • 

A two-page Picture Naming bookie^ consisting of 31 pictures (ba^ed 

on the" results of the pilot study) was distributed to each student. 

The pictures were arranged 'in rows of four. Many of the rows were made- 

up of pictures which shared a com^ion feature — that is, a plural naiAe 

or^an arrow which pointed to a particular part of the pictur^. (Appendix 
\ 

"A contains a page' from the Picture Naming bookie^ for the Consonants 

r 

Subtest ,) Students were instructed to 'looky at one row of pictures at 
a time. The examiner pronounced the name of each pictiare in that ijow 
and the children repeated the naune aloud/ When the names of all 31 

. . V 

pictures* had been identified through this procfedure| the Picture Naming 
booklets were collected, > , . , 

Consonants subtest . Following the Picture Naming Exercise, each 
Student was given a copy of the Consonants Subtest. The examiner 



explained to the children that they would be listeningt for cQ^sona^t 
sounds at the beginnin g of. words* The examiner then instructed the 
studenta in each of the three practice items. At the *^nd of *the. 
practK^ period {approximately 9 minutes) , the students were instructed 
to work independently on the actual tes}; items until they reached the 
large J^tog^ign on the eighth page* The children were told that if 
tBey completed all' 49 items before the ^allocated time wa^' up, they could 
"qcr back and' review 'tEelr answers . 

\ After completing .the Initial Consonants section of the Consonants • 
SubtQSt, the examiner explained to the children that <:hey were* 
qoing to be listening for consonant sounds at the. end of words* The 
examiner instructed the students in the three practice items for final 
conson».mt ;sounds. At tfie end of the practice period (approximately 
3 minutes) , the children were directed to work independently on tne 

V ' . 

actual test items "and to complete ail 32 items • remaining in the 
booklet- The children wer^told th^t if they completed * the Final 
Consonants section before the allocated time was up, they could review 
any of their work in « the entire booklet. 

The students took approximately 30 to 35 minutes to complete both 
the Initial Conson^ts and Final Consonants sections (including practice 
.items) of the Consonants Subtest. 

Oral reading tasks . Two oral reading tasks were individually 
admini3ter.ed to assess for concurrent validity of the Consonants 
Subtest. Approximately 32% of ^he children frotn each classroom were 
randomly selected to participate. The first task required that the 
student read aloud a list of 81 target synthetic words from the 



^Coasonants Siibtest.. As the student read the list the 
examiner noted all pronunciation errors made on target sounds »^ 

Following the oral reading of the word llat^ the student was in-* 

,structed to read aloud a 211-word poem* ,The poem includecl several 
wqr^Si'^containing each of the speiling-to^sound correspondences assessed 
in the Consonantly Subtest. The examiner noted all ^Pronunciation. errors 
on target cyrespondences^^^ (The stude nt copy_pf .the^irst page from - 
the word list and the poem are presented in Appendix B,) 

The total time for the administration of ^ the oral reading tasks v 
ranged from 2 to 15 minutes, with the word list taking 1 to 10 minutes 
and the poem taking 1 to 5 minutes. In general, third grade students 
required more time to perform the tasks tha;^ did fourth and fifth 
grade students. 

« 

All tests were administered by ^taf f members from th? Wiscon^ip. . ^ 
Research and Development Center for Individualized Schooling. Directions 
for the Picture Naming Exercise and* the Consonants Subtest were read 
from an i^tiaministiratar ' s Manual. Teilting was conducted on February 6/ 
1979. 
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f Results 



A total 'of lS7^^iMip grades three ^ four^ and°five participated> 

in the study to"^ evaluate the Consonants Subtest. Summary statistics 
on th^ Consonants ^-i^abtest^ by grade level, are presented in Table 3. 



Mean percent correct on the total subtest {Ba items) was above 90% 
for all three grades. Overall Hoyt reliability estimates were .78, 



Table 3 
Conspnanis Subtest: 
Percent Correct 
SununarV Statistics by Grade ^ / 



Grade 5 Grade 4 Grade 5 



N = 89 N = 61 • N « 37 

X =91.27^ X » 92.27% ^ X = 93.29%. 

SD = 5.53 SD = 6.39 , SD = 5.15 

R-=»rige^ r 3j9'26 - Range^ = 51.85 - ' j Range^ = 1}'^^ " 

97. 5\ . 98.77 , 97.53 

Range T= 48 - 79^ Range__ « 42 - 80^ ' Range„^ = 58 - 79^ 



a 



Ult of a possible Bi items. ' ^ \ 



.86, and *81 for grades 3^ 4$ and 5^ respectively^ analyses were -. 

performed to gain infpnnatioi;!' abbut indivldifal items # as well as the* 
item categories within the total test. 



T^gep^ ty^s of > analyses were perfonoed os) the 'data: a comparison 
of mean scores for ^bnsonant^ in initial versus final position; a ' 



comparison of mean sco;ces single-letter consonants^ consdnani; * 



£br si 



clusters^ and ^ consonant digraphs; and an examination of thamean 

-> 

scores for the three or ^our items assessing. each of the 25 spelling*- 

1 ■ • • ■ . 

to-»sound corri^spondfences assessed in the Consonants Subtest"* 

* . .'■'». 

Thq first analysis^compa»ed performance on items assessing 
consonants in initial j^psitibn w^^th performance on items assessing 
consonants in final posittion. As Illustrated iiylfi^lB 4, (^^ildrerTat 

'J 

each grade level achieved, higher performance on consonants in xnxtxal 

position than on consonants in final po;sition.. Mean differences 

/• 

between performance on initial versus final items averaged 4; 48% across 

r 

grades. 

The second analysis compared performance on the three categories 
of consonants which ^comprised the total subtest: single-letter conso-- 
nants (51 items), consonant clusters (15 items), and consonant digraphs 
(15 items) ♦ Results *from this analysis are presented in Table 5. Once 
again, differences between grades were small. -For all three grades^ 

The third analvsis e^xamin^d performance on the 25 different 
spellxng-to- sound rorrespondences"^ssessed in the 181-it^ Consonants 
Subtest- Performance on all test items for 17 of the 25 correspondences 



26 



•Table 4 , 

.... - ' * ♦ 

Consonants Subtest: Comparison of Consonants' 
in Initial and Final Positions 



Nuniber of 
sub jects. _ 



Mean % 
correct 



SD 



Total 
number 
of-^teitts 



Range of scores 
(% correct) 



Total group 
Initial 
Final 



187 



93.77% 



89.29% 



6.15 
7.02 



49 
32 



42. 8& - 100 
59.38 - 100 



Grade 3 
Initial 
Final 



B9 



93.10% 5.66 



88.48% 



7.29 



49 



32 



59.18 - 100 



59.38 - 100 



Grade 4 
Initial 
Final 



61 



94.08% 



8?. 50% 



7.49 
6.70 



49 



32 



42.86 - 97.96 



65.63 - 100 



Grade 5 
Initial 
Final 



37 



94.87% 



4.63 49 



90.88% 6.77 



32 



75.51 - 97.96 



65.63 - 96.88 
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Table 5 • 
Performance (% correct) by Grade on 
Single-letter Consonants, 
- Consonant Clusters, and 
Consonant Digraphs 



Grade 3 
(M = 89) 



Grade 4 
<N « 61) 



Grade 5 
(N « 37) 



Total 
sample 
(N « 187) 



Single- , 

letter 
consonant i5 
(51 items) 



X ^ 97^00% 



X = 98.47% 



X = 97.3(3% 



X = 97.54% 



.Range = 53.33 - 100% 53.33 - 100% 



73.33 - ,10,0% 53.33 - 100% 



Consonant 
clusters 
(15 items) 



X =? 90.46% X « 90.39% 



— . ,( 

X « 92.05% 



X = 90.75% 



•Range = 66.67 - 96.08% 52.94 - 98.04% 74.51 - 96.08% 



Consonant 
digraphs 
(15 ' items) 



X = 75.06% . X = 79.13% 



X = 80.18% 



52.94 - 98.04% 



X « 77.40% 



Range = 26.67 - 86.67% 33.33 - 86.67% 46.67 - 86.67% 26.67 - 86.67% 
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^war. correct or greater. One item aatiusaing tlH-* speiiing--to-;aound 

♦ • • . 

y correspondence for .had a nean percent correct score of 92.5 (because 
'* number of students chose the foil ending witfr/ng/ instead of the 

' . ! i ' • , ^ r ' ' " ■ '"' ' * ' ' ' - 

correct response chc/ice Which ended in /n/) . All other caseft where " 
mean percent correct scores were lower than 95.0 involved items 
- cts^^ssing the three single-^ietter consonants {c, and q ) , which 

' had two common sound correspondences, or items, assessing one of the 

\ u • ' ' . , 

% , two digraphs ^>h^ and m^. 

For the three single -letter consonants with two common sound 
correspondences, four items were used to test> each correspondence • 

* . 

students ' performances on the 24 test items assessing the consonants ' 
with variant sound correspondences are presented in Table 6 » -Table 6 
also provides* data on the percentage of students selecting each response 
; choice. Five types of response choi-er were included in the test 
items that aus^s^ed consonants with v.iriant correspondences^ (1) a 
*. Correct response choice, (2/ an Acoustically Close response choice, 

{3; a Visually Close respon:;<> choice, (4) a response choice that was 
Neither Acoustically Close Nor Visually Close (Neither) to the Correct 
resix)nse choice, £^nd (5) the other Common Sound Correspondence for 
tho Consonant. All itoms u:.ed a Correct, an Acoustically Close, and 
a Visually Close response choice. In two of the four items for each 
correspondence, the Neither Acoustically Close Nor Visually Clos|||^ 
(^Jext^er) category wa^r used m a fourth response choice. For the 
remaining two items, the Other Common Somid Correspondence category 
was used as a fourth resporse choice • An inspection of Table 6 



.'1 



- * . Table 6 

^Itcni' Analysis of SixaVariant Consonant djrt^i spondences 



fpi; Total Subjects 



• 










•• 










« IS?) 


* 






> 




$ 


- 






Other ^ 


• t 


• * 


'> * 








Common 








Acous- ^ 








Target 


• 




— ■ 




Sound 






ticaily 


Visiially 




Corres-^ 
















pondence 


correct 


response* 


foil 


foil 


.foil 


foil ■ 


c as /k/ 


• 97 


■ 

98.4 


1.1 






.5 






98^9 


0 


0 




.5 *-t 


- 




96^3 


3.2 




.5 








95.7 


1.1 




0 




c as /s/ 


'65 


• 

4.8. 


0 . ■ 


2.1 




92.0 






91.. 4- 


2.7 


2.7 


1.6 








97.9 


.5*. • 


0 ' 


•1-1 








66.3 


.5 


23.5. 

t 




4.8 


• 

1 as /g/ • 


95 


98.9 


0 


1-1 


0 








95.7 


0 


.5 




2.7 






98.9 




.b 


0 








87.2 


. .5 ■ 


0 


- 


12.3 




81 


73.3 


2.7 


6.4 


• 7.5 








8$. 6 


0 


. 3-7 


1.1 


— 






•73.8 


.5 


0 




25.1 








0 V 

e 


0 




9.6 • 


s as /s/ , 


87 


87.7" 
94.7 


11.8 
.5 


0 

.5 


0 
% 


3.2 






95.7 


2.7 


0' 


' 1.6 








68.4 




2.1 


t 


28.3 


s as /z/ 


73 


27.3 


0 


2.7 


1 


70.1 




< 


Tt,7 


0 


0 




28.3 






98.4 


0 


Q 


1.1 








93.0 


1.1 


1.1 ' 


2.7 





Note. All the totals do not >add up to exactly 3,00% because the 

4 

figures were rounded off to the nearest tenth of a percent and also 

because on soraeTtems a few students did notj^select any of tha response 

■* • * * 

.• ^ 

choices • . ^ " - 
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reveals that when the Other Coromon Sound Correspondence category wai 
used as a foil., studgvnts selected th& Other Common Sound Corresgjjn- 
dence -.response" choice in percentages ranging from .5 (in both c as 
A/ items) to 92.0 (in one c as /s/ item). When a variant sound 
correspondence for the target consonant was not present as a foil, * 
incorrect responses were fewer and fairly evenly distributed across 
the three foil categories. When a variant sound corr.espohdence was 
present a.s a foil, the mfean percent correct for that item was only 
73.1, cornered to 92.8 on items where the variant sound was not 
present as a 'foil . * • . 

Overall perfoj;mance was ^lowest (mean percent correct = 65.0) on 
items assessing the c a s /s/ correspondence. In contrast, c as /k/ 
items yielded a mean percent correct of 97.0 for the total sample. 
Results for the letter-sound correspondences f or \s_ showed a mean 
percent correct of- 73.0 for s as /z/ items and a mean percent correct 
of 87.0 for s as /s/ items. In analyzing performance on the two letter- 
sound correspondences for in items where .the variant sound was 
presented as a foil, the mean percent correct was 82.1 on the as 
/i/ items, but was 91.4 on the as /g/.atems. In analyzino students' 
performance on the item?; for thu three, single-letter consonants with* 
variant sound correspondences, performance was higher for the variant 
consonant correspondence in each pair that-had the greater frequency 
or occurrence m the language (according to Venezky, Note 1) . 

Information on subjects' performance on the six items assessing 
the two digraphs ng, and ph (there are three items for each digraph) , 
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is f>resented in Table 7; -As shown in the table « items assessing n^ 
yielded an overall mean percent correct of 86.0 for the total group. 

Items 'assessing the £h digraph yielded an ovez^alX mean percent 

\ 

co^j^Qt of only 72:0* ^ ^ \^ 

For each item assessing a digraph, the ^oiir response categories 
of Correct, Acoustically Close, Visually Close, and Neither Acousti- 
cally Close Nor Visually Close (Neither) were utilized. Each ^ , 
picture in the Visually Clos^iirtcategory had a name which beg^ or ended 
in ^ne of the two consonant letters of the digraph. This, however, 
resulted m havs'ttg many Visually Close foils that^were alsoj. 



Acoustically Close/^^d vice versa. For example, xici^ an item testing 

ph as /f/ in final position, the target synthetic word is sagh. The 

Correct response choice is cuff and the Acoustically Close/ response 

choice is teeth. The Visually Close response choice is map, b^^ause 

ma p ends with £, one of the two consonant letters of the j^h (iigraph. 

According to the Miller and Nicely (1955) confusion^ matrices for the 

perception of consonant sounds, the sound corresponding to 

the letter £ (/p/) is sometimes confused for the sound /f/.' Hence, 

/p/ is acoustically close to /f/, as well as visually close to pX^ . 

As i5hown in Table 7, when a foil category overlapped, thus creating 

a ^^sponse that wa^ both acoustically close and visually close, most 

«» 

Students who responded incorrectly chose the overlapping response 
foil. This was the case for all six items assessing the gii as /f/ 
ar\d tho t^^i ^s /jg/ target correspondence^. 

Fifty-nine^ oT the 187 children (32%) in the Consonants Study were 
ra/idomly selsv^od for testing on the two oral reading taslfs. ^he 



Table 7 
Item Analysis of' 
Digraph Correspondences 









• 














Overlapping 






• 




Acous- 


Acoustic 




Tarqe t 






tically Visually 


and 




corre- 


Mean % 


Correct 


Close Close 


Visual 


Neither 


spondence 


correct 


response 


foil •^^•^^il 


foiia 


foil 






90.4 


0 ' 7.5 


r— / 


.5 


n^L as /rj/ 


86 


89.8 


1.6 


4.3 


2.7 




79.1 


5.3 , 


13.9 


.5 






69.5 


* 

1.1 


23.0 


3.7 


£h^as /f/ 


- 72 


• 62.0 


. - 1.1 


34.8 


0 






84.5 


1.6 


10.2 


1.1 


• Note* ' 


Ail ..tiie 


C 

totalV do not add up to exactly 100% because the 


figures 


were roui\dti 


id off 'to 


the nearest 


tenth of a percent and 


also because on each 


* 

item a ft^w 


studt»nt.s 


did not select any of the response 


choices. 




contained one 
* 


of the two 


letters of the target digratih that was 


■ also 


acuusLiwjaiiy close ' 


to the letter rfcSouQd correspondence 


for that digraph. 
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purpose was J^o ascertain whether the written tes^^as# in factr 
sensitive to the kinds of phonics errors that student^ are likely to 
make in a true reading situiation. Each thild was first asked to read 
aloud a list of the 81 synthetic words used on the written Consonants 
Subtest. The childrens* productive errors c5n target, correspondences 
were noted by the examiners . E^ch student Vas next instructed to 
read aloud a Zll-^word poem which was written to include several words 
containing each of the 25 spelling-to^sound correspondences assessed 
in the written Consonants Sij±)test. Again, errors on target corres- 
pondences were noted. Results of the oral testing ^re presented in 
Table 8. Examination gf this summary data indicates that students 
made nearly three times more errors on the written Consonants Subte'st 
an<3 on the oral reading of the synthetic word list tJian on the ^ral 
reading of the poem* Probably the benefits of context and prior kfiow- 
ledge of words in the poem were responsible for this difference. 
Children made many moi:4 errors on the spelling-to-sound correspondences 
when they were asked to •read the list of synthetic ,wovds — words with- 
out context and about which they could hAve no previous knowledge • 
It is interesting to note, however', that agreement between errors on 
the Consonants Subtest and errors on the poem is not very different" 
from the agreement between errors on the Consonants Subtest and errors 
on the synthetic word list. The percentage of agreement with the 
Consonants 'Subtest was 27.8 and 26»9 for the poem and word list^ 
respectively. °This provides good evidence for assuming that the 
written Consonants Subtest was equally sensitive to errors made on 
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Table 8 



Summary Data on Oral Readir^g Tasks . 
and Consonants Subtest Across Grades 



<N ^ 59) 



• I.- 



Oral xeading ta^ks 



Poem 



Synthetic word 

1X3% 

X 1. 



Consonants 
Subtest 



Number of stu/^ents 

rXumber of students 
^ making phoajLcs 
errorfe ^ • 

Total number of 
errd^rs \ 

% of AgjteeiT^pnt 
with^^nsonants • 



£9 



^^1 1 



xio 



27.8 



59 



54 , 



59 



59 



374 



26.9 



335 * 



* 

lao^ i-crccntaqe of ag^eeinenjt waa calculate^ determinirtg' the ^ f 
ratio of a ^ituUent's error's coinmon to. th? Synthetic Word List .and Written^ 

Test ovor the TQtal Number of tha^ Student's errors roade'on the synthetic 

■•' ^" i ■ 

Word List alone, o.q., ' ' * • • 

Number of errors ebimnon to Syrithetic 
% Agreement for Syrith«?tic Word List = Word Lis t and Written Test 

<* '. " ' . ' ' 

■f- V Total Number of Synthetic Word 

List Errors 

and then surfmincj these percentages across all students that did the oral 

reading tAsljs. The some procedure was us'ed to calculat^ the percehtage ' 

.* _ * * - * ■ . 

ot- agreement for the poerti and Written Test errors. 
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meaningful material as it was to^errors made in pronouncing isolated 

reading of synthetic words were not made on the written Consonants 

ft . '• 

Subtest. This may have resulted^rom the limiting nature of the 



* 



foils'* For example r in an item assessing the letter c as t^V sound 
/s/^ a child may have read the synthetic word plice as pli/k/e, 
instead of as pli/s/e on .the oral task. When the child came to that 
item on the written test, the alti^nate sound for £ (the sound /k/) 
may not have been included as a foil • Because the other comn\pn sound 
correspondence of a consonant was used as a foil in only 50% of tbe^ 
items on the Consonants Subtest ^ the child had a better cfiance of 
responding correctly on the written item than in the productive task 
required by the oral reading of the synthetic word list. This foil 
constraint effect is suggested in Table 8 in the comparison of the '.total 
number of errors (374) made on the synthetic word list with those (335)" 
made on the written Consonants Subtest. 



DiscussxJn 

ft 

Several ^interesting results were obtained from examination of the 

^ data on \he Consi^nants Subtest* Performartce on consonants in initial 

\ 

. position was superior tb performance on consonants in f^nal position^ 
which replicates th^ findings in the . research litetrature. Studies 
•have shown that younger readers ^ttend more to the first letters' 
and sovands in a word than to the final letters and sounds* 
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Xti the analysis of performance in terms of the three consonaat 
categories (single-letter consooanta, consonants clusters, and 

r ... - ^ 

consonant digraphs) ^ a consistent pattern was revealed • All three 

of the grades tested scored highest on consonant clusters and 

lowest on consonant digraphs • While it might have been expected that 

performnce on single-^ letter consonants woul'd have been superior to 

» • ■ - , ^ 

performance on consonant clusters, the single-letter eonsonaj;it 
category incljided items assessing variant scund correspondences for 

/ * 

three letters (c, g.' s) • It was c],ear froj?i the error analysis that 
the inclusion of these co»®onantp,» which have more ' lan one conunon . 
sound correspondence, was responsible for the lower overall performance 
on items in the single-letter consonant category, 
Ls^ When each of the 25 spelling-to-sound correspondences was analyzed 
separately, the most noticeable variation in performance appeared in 
items where the consonants had another common sound correspondence 
(the consonants SL* c^nd s) . In addition, children appeared to have 
experienced difficulty with two of the digraphs ^ and n^^. On items 
assessing these digraphs, children tended tcT pick incorrect response 
choices containing the first letter of each digraph, i.e*, £ for £h 
and n for ng > 

Overall performance was high on the Consonants Subtest, with mean 

scores on all but 5 of the 25 correspondences assessed reaching at 

least 95% correct* Even third graders appeared to have mastered most 

I 

of the Consonants Subtest items. Only a relatively small proportion 
of students {from all three grade levels) displayed any degree of 
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difficulty with consonant correspondences. Errors, when t^ey did 
occur, were usually made either on consonant digraphs or on the three 
single-letter consonants which have other common scnmd correspon-X 
dences (c, g.' '^V^ 

The oral reading tasks were originally p anned as' a measure of 
concurrent v,. \ Uty, The standard procedure for determining concurrent 
validity is to correlate performance on the newly devised* instrument 
with performance on an established measure of the target skills • The 
survey of tests with existing/ phonics components ^revealed, however, 
that there is no phonics mea/sure currently available that validly, 
assesses childrensV phonics \ki lis . The oral reading of the target 

synthetic word list appears to be a more reliable indicator of pure 
/ #^ • » 

phonics knowledge than the oral reading of the poem. While there is 
no established criterion for evaluating the level of ,the percentage 
of agreement, results indicate that the written Phonics Test is 
sensitive to a substantial percentage of the kinds of phonics errors 
that children make vAien reading orally • 

The most interesting) finding of the oral reading study wa^ that 
the percentage of agreement between the oral reading of the poem and 
performance on the written Consonants Subtest was comparable to that 
between the oral reading of the synthetic wprd list^^and the written 
Consonants Subtest* This seems to suggest that# even though children 
made significantly fewer errors on the poem^ the errors^they did make 
were as likely to appear on the written test as were the errors, made 



on the synthetic word list.^ 

s 



^ 'V - • DEVELOPMENT OF THE VOWKJUS SUBTEST ^ 

The Vowels Subtest is designed to^ assess 20 different spelling- 
. , to--sound correspondences^ Sounds selected for testing were long voxels ^ 
short vowels, and vowel clusters* 

' ' Method 

Subjects * * 1^ 

■ ' ' ■• ■ . 

A total of 190 third, fourth, and fifth grade pupils from the 
Oregon, Wisconsin Public School District participated in the present 
study (s^e Table 9). Most of these pupils had also taken the Conso- 
nants Subtest in February 1979, Third grade pupils were from Oregon 
Elementary School; fourth and fiftji grade pupils formed a mixed-class 
1 . unit in Oregon Middle Schools 

The Vowels Subtest assesses 20 different spelling-to-sound corres- 
pondences with 60 items. As in the Consonants Subtest, each i^tesxi 
consisted of a synthetic word with the target letter (s) underlined 
and fourji^esponse chdicos in picture form. Children were instructed 
to read the synthetic word to themselves and decide the sound of the 
underlined letter (s)./ Next they were told to circle the picture in' 
that row^hose name had a medial {or final) sound that was the same 
as the sound of the underlined letter (s). Figure 2 is a copy of the 
<iirections and practice items from the Vowels Subtest. 
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Table 9 

\ * 

VoweX^ Subtest; 
Subject - Population W School and Grade 

(N 2^0) 



Schools and 
classrooms 



Grade 3 



Grade 4 



Grade 5 



Oral Oral Oral 

Vowels reading Vowels reading Vowels reading 
Subtest tasks Subtest tasks Subtest i:asks 



Oreqon Elementary School 

Classroom A 21 

Jlassroom B 24 

Classroom C ^ 25 

Classroom D 22 



5 
5 
5 
5 



Oregoia Middle School 

Classroom A 

Classroom B 
Classroom C 
Classroom D 
Classroom E 



10 
14 
12 
16 
13 



3 
3 

5 
3 



3 
6 
8 
9 
7 



2 
2 

1 
2 



Totals 



92 



(20) 



65 



(14) 



33 



(7) 



r. r 



) 
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PHONICS: Vowels 



Medial Position 



m each row, look at the made-up word. Notice that there is a' letter 
or letters underlined an the middle of that word. Read the word to-, 
yourself and decide how that, letter or .letters sound . Then find the 
picture in-^'the row whose name contains the sound of the underlined 
letter pr letters. Remember, you are looking for a picture whose 
name contains the same sound. This vowel sound may or may not be 
spelled with the same letters as in the made-up word. Draw a circle 
around the picture whose 'name contains the sound of the underlined 
letter or letters in the made-up word. 



'yube 



B. 



'out 










Fiqure ?. . The directions anil practice items from the first page of the Vowels 
Subtest. 
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Target vowel sounds were selected according to th^ir frequencies 

of occurrence in the V^nezky (Note I) corpus of the 20^000 'most conunon 

English words* Only those spell in9-to-*sound correspondences with 

total frequencies of 150 or more (with the exception' of four vowel 

clusters^ which have frequencies between 123 and 142) are included in 

« 

the Vowels Subtest. These spelling-to-sound , correspondences appear 
in one-syllable, target synthetic words that conform to phonological 
properties of the English language. 

The response choices for each item are fpur pictures whose names 
are v^ell 'known to elementary* school -age children. For each target 
item, the four, response choice categories are: (1) a Correct response 
choice, (2) an Acoustically Close response <;ho ice, (3) a Visually 
Close response .choice, and (4) a Neither Acoustically Close Nor 
visually Close (Neither) response choice. 



Selection of Target Sounds 

Long vowels . All five single-letter vowels that correspond to 

long vowel sounds were selected for testing. According to Venezky 

(Note 1) , the five long vowel sounds, long a (as in cage) , long <e (as 

« 

in mete ) , long i^ (as in hide) , long o (as in bone) ^ and long u (as in 
flute) ^, have spelling- to-sound correspondences with frequencies 

. : # 

^Whiie the sound of u in fuse (the diphthong ju or iu) occurs 
more f recjuently than the sound of u in flute (the simple vowel u) , 
only the latter letter^sound sound correspondence was used in the 
Vowels Subtest. This is because there are few one-syllable picturable 
words with u as in fuse that are well-known to elementary school 
pupils. Except for the sound correspondence for th- letter u in 
.inifcial position, the two sound correspondences abo- for u are 
considered to be very cjLose. * 
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exceeding^ 150 • Acrording to Kenyon and Knott •s (1953), "A Pronouncing 
Dictionary of Amorican, Eng-lish" — the source used, by Venazky for the 
pronunciations o£ the 20,000 most common English words — long and 
lonq u are always designated as simple vowels, whereas long is 

c 

always designated as a dipHt^ong. Long a and long o, however, can be 

designated as a simple vowel or as a diphthong. For the purposes of 

this study, however, both long a and long^ will be considered diphthongs 

This is because the vowel sound in CVC 'trigrams is more commonly 
* 

pronounced as a diphthong than as a simple vowel and all the target 

* * 

\ synthetic words and the picture names of the response choices used in 

testing vowel sounds in medial position are CVC trigrama. 

Short vow3ls > All five single-letter vowels corresponding to 

short Vowel sounds were selected for testing. According to Venezky 

(Note 1), these five short vowel sounds, short a^ {as in bat) , short e^ 

(u3 in ££2^) , short £ (as in l id) , short o (as in shot) , and short u 

^HSli^ ' have letter-jLo-sound correspondences with frequencies 

exceeding 150. (All five short vowel sounds are designated as simple 

♦ 

vowels . ) . 

^ Vowol clusters . The 10 two-letter vowel clusters with the 
highest spelling^to-^sound correspondence frequencies (ranging from 
320 to 123/ according to the Venezky tabulations) werp selected for 
testing. Five of these clusters have simple vowel sound correspon- 
doncos: ea (as in bead ) , ee (as in green) , oo (as in spoon) , au 
(as in taut ) , and ea. <as in bread) ; the remaining five vowel clusters 
correspond to sounds of diphthongs : ai_ (as in maid)', ou (as in loud) , 



ow (as in town) , a;j^ (as In play) , and ow (as in .snow) . 

Long vowels, short vowels, and vowel clusters are generally.. 

t^afsted in\he medial position of words w^'ich, according to' the 

^Venezky data, is the position laNdrich they most frequently pcctir^ 
I • > . . 

vThe vowel cluster a^ (as in ^lay) , however, occurs most frequently in 
^nal position and therefore* is tested in final position o^nly. The' ^ 
vowfel cluster ow (as in snow) occurs frequently in medial and final 
position and therefore is- tester in both medial and final positions. 

i\ll 55 of the items testing vowel sounds in .the medial position 
use one-syllable picture names and target synthetic .words which 
conform to a CVC pattern • Wi^thin any item, the filial ponsonant 
sounds for . the target** synthetic word i^nd £lie four pictxure names are 
either all voiced or all voiceless consonants. Because the final 
consonant sound in a CVC word affects the dtiration of the medial 

. ■ . - ■ • «■ 

vowel (and, in the Vowels .Subtest, the medial vowel sound is the ^ 

sound of interest) , this practice of using either air voiced or all 

v oiceless final consonants in the* response choices provides some 

degree of consistency for medial vowel duration. 

* 

Selection of Response ghioxces ^ . 

Ea^h of the 60 items in the Vowels Subtest has four response 

■ / ■ . ^ • 

choices xn xacture. form* 



Correct response choice . This response choice is a picture whose 
name contains a medial or final v©wel sound identical to the sound 
corresponding to the underlined^Tetter (s) of the target synthetic 
word . 
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A coustically CXose response choic e. This response choice is a 
picture whose name c6ntains a medial or final vowel sound that is 
acoustically close- to the sound corresponding to the underlined 
^ tter(s) in the tarqet synthetic word. Whenever possible, data from 
t*: Peterson and Barney CI952) confusion matrix were used to 
deterrv no an acousticaliy close sound. (The Peterson and Barney 
study reported perce'ptual confusions by adult observers under an 

V, 

approximately 70 decibel level for iO .pimple vowel soxinds, each 
presented 152 times by men,^ women, an4^children speakers.). To 
illustrate how the information from' the matrix was used to determine 
an Acoustically Close response choice, consider the target sound 
short a (as in nan) . The Peterson and Barney confusion matrix 
indicates that short a^ is most often confused as short e. Hence, in 
an item assessing t^e sound of short a in medial position, the target 
synthetic word is vadv The Acoustically Close response choicre for 
this item is a picture of a web , because web contains the acoustically 
close sound of short in medial position. ^ 

The Peterson and Barney confusion matrix does not provide 
confusion, information for long vowel and vqwel cluster sounds that are • 
dIr^hthonqs. * Hence, in tl^ese cases, speech production data (Denes & 
Pinson, 1973; Keny^^n & Knott , ''l953; Langacker, 1973) were used to 
construct the Acoustically Close response choice. (Evidence suggests 
that Sf^xinds produced in proximal positions within the oral cavity are 
more likely to be confused than sounds produced in more distal 
positions . ^ Ai^r Acoustically Close response choice could therefore be 
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determined frpm this information.) For example, the vowgI clustet or 

diphthong, ou, is? produced from a low-central /a/ to a lower -high l>ack 

V 

Af/ position in the back of the oral cavity. An acoustically 



<ciose 



vowul sound would be / o /. (aiS in pawn) , which is produced in the higher 
low-Jback position ia the oral cavity — quite close to where the ou- 
^-Jound is produced.^ Therefore, in one of the items testing the sound 
of ou in medial position, the target synthetic word is f loud . The 
Acoustically Close response choice for this item is a^picture of 



saws , because saws^ contains the medial vowe^ sound /aw/» 

Visually Close response choice >^ Tl'fi^ response choice is a 



picture whose name contains t;he same letter as the underlined letter (s) 
in the target word. For short and long vowels, the sound of the 
letter in the pictur^, however, is the short or long^ counterpart of 
the sound of the underlined lett^. For example, in an item^estiaTig ^ 
short a the target synthetic wo^d vad. The Correst response choice 
is a picture of a pan because^^ pan has a short a i^ medial position^ 
The Visually Close response choice is a pictare/of a cage, because 
^J^l\ *-'^^ntuins a long £ in medial josition. Hence, the a in' cage looks 

\ ■ 



liko, hut docs not sound like, the a in vad. 



For vowel clusters, we decided to use one of the two^ letters 
nf the cluster for the Visually Close response choice. In an item 
toiitinq ou in medial position, the target synthetic word ^s f loud . 
The Visually Close response choice is a picture of a frog, because 



2 

"rht,' termf; .ind locations of tiic fxjjsitions within the oral cavity 
th</s^^ vowei sounds an:* taken from Kenyon and Knott's, ''A Pro-^ 
/jouncing Dictionary of American English" (1953), p. xiii* 
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^ rog contains only one of the letter^, the o of the two-letter vowel 
^'iu.ftyr ou. tAru>thor Vi^^ually Close resjonse choice could have* 
been a> picture a rug, because rug contains u, the other lettear in 
the vowol ciCaiStor ' ou. ) 

Neither Acoustically Close ^or Visually Cjose (Neither) response 
choice . This response choice is a picture whose nanvC'has neither a 
sound that is acoustically close, nor letters that are visually close, 
to the underlined letter (s) in the target synthetic word*. As with 
the Consonants Subtest, this category was created to see whether 
children making errors would apply an audi-tory strategy (by selecting 
the Acousticatly Close response choice) , a visual strategy (by 
jclectina the^ Visually Closo response choice), or if they would 
merely guess at the correct answer. A pattern of responses having a 
disproportionate number in the Ntjither response choice category 
might indicate a tendency towards guessing. 

Poi ui^amplc, in the test .item for short a in the target synthetic 
wuia tMO No) timr^AT^R{x.nu choice is b room . The vowel sound 

^■^ made m Uie hiqh-back fx^sition of the oral cavity. 

T:io siu:)ri: a in vad is produced in the low-front position of the oral 
cavity. Therefore, the /u/ in broom is not acoustically close to the 

in vad. Moreover, the oo^ in broom is also visually different from 
tiu' ciinqle a in vad.^ 

Procedure 

For all grades^ a Picture Naming Exercise was given prior to ad- 
minister ifv .he Vowels Subtest of the Phonics Test. Upon completion 



of the Vowels Subtest, a randoKi sample of students also participated 

in two oral reading tasks. 

^P icture Naming Exercise , It was important to en'sure that the 

pictures in the Vowels Subtest be identified by their designated 

* 

names. Therefore, a short exercise in naming pictures preceded the 
a^iaistration of the Vowels Subtest. A picture was selected for 
the Pictur^e Naming Exercise if it met one of two criteria: (1) the 
picture was created specifically for the Vowels Subtest, or (2) the 
picture had been included in the Picture Naming Exercise for the 
Consonants Subtest • 

A two-page Picture Naming booklet GonsistingX>f 49 pictures was 
distributed to each child. The pictures wer^ arranged in rows of four. 

■■ \ 

Many of the rows were made up of pictures which shared ajpommon 
feature, such as a plural x^iame or an arrow pointing to a particular 
part of the picture. (Appendix C is a page from the Picture Naming 
booklGt for the Vowels Subtest.) Students were ins.tructed to look at 
one row of pictures at a time. The examiner pronounced the name of 
each picture in that row and the children repeated the picture name 
aloud. When the names of all 40 pictures had Been identified thrdugh 
this proced u r e , the Picture Naming booklets were" collected. - 

Vowels Subtest . Following the Picture Naming Exercise^ each . 
student was given a copy of the Vowels Subtest. The examiner explained 
to the children that they would be listening for vowel sounds in the 
middle ^ind at the end of words. Next, the i?xaminer instructed the* 
students in the two practice items for medial vowel sounds. The 
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exaininer then told the students to. turn past th« stop sign to\the 



0 



second to \tl;e last page ia their booklets. .The* examiner explaitied, 
that alj the items up to the stop sign, would be on vowel sounds in 
medial position; the two pages after the stop sign would be on - 
sounds in final position. The examiner instructed the Children in the 
one practice item for final vowel sounds. At the end of the practice 
period (approximately 5 minutes), students were directed to work, 
independently on the 55 items , on medial vowel sounds and on the 5 items 
on final vowel sounds. The Children were told that if they completed 
all 60 items before the allocated time was up, they could review any 
of their work in the entire booklet-. ' ' \ 

. The children took 12 to 30 minutes to complete both the medial 

■ < 

and final vowels, sections (including ^r act jtce items) of the Vowels 
Subtest. 

•;^ Oral Reading Tasks . Two oral reading tasks were ^ individually 
administered to assess the concurrent validity of the Vowels Subtest. 
Approximately 22% of the students who took* the Vowels Subtest were 
randomly selected to participate in the oral reading ^i^ks. The first 
task required that the child read aloud a list of the 60 target 
synthetic words from the Vowels Subtest. As^the child read the list 
of words ^ the examiner noted all pronunciation errors made on target 
sounds . 

Following the oral reading of the word list, the child was in- 
structed to read aloud a 347-word poem. The poem included several" 
words containing each of the spelling-to-sound correspondences 
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assessed in the Vowels Subtest. The examiner noted all pronxmciation 
errors on targ^ correspondences. (The student's copy of the first 
page of U,a wo.d list and Che poea are preseated in D., 

The total time for the administration of the ojral reading tjasks 
rangec^ from 10 minutes^ with the word list taking approximately 

1 to 5 minutes r and tJ^ poem taking approximately 2 to 5 minutes. In 
•general r third grade jpupils required more time to perform the tasks 
than did fourth and fifth grade pupils. 

All tests were administered by staff members from the 
Wreconsin Research and Development Center for Individualized Schooring. 
Dir(|ctions for the Picture Naming Exercise and the Vowels Subtest were 
read from an Administrator's Manual. Testing was conduc£ed on May 22, 
1979. 

Results 



A total of 190 students in grades three, four, and five partici-- 
patod in the study to evaluate the Vowels Subtest. Summary statistics 
on the Vowels Subtest, by grade, are presented in Table 10. Mean 
percent correct on the total test (60 items) was better than 75% for 
all threti grades. An item analysis was performed to gain information 
on the overall reliability of the test anjT the relative performance 
of individual items within the test. The Hoyt Reliability Coefficient 
for the Vowels Subtest was high at .89, with a standard error of 
measurement of 2.85. * 

In addition to the item analysis, a series of t*- tests were 
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Table 10 
Vowels Subtest: 
Percent Correct 
Suxtunary Statistics by Grade 



I 



'Grade 


3 




• 

Grade '4 


Grade 5 




N = 92 






N = 65 


N 33 




X = .7585% 






X = ..7808% • 


X =^ .3010% 




SD = .1G5 






SD = .118 


SD ^ ,134 




R^nge^ - 18 - 


100 




Range^ =47-98 


Range^ = 52 - 


100 

• 


P^nge^ = 11 - 

• 

1 


60^ 




Range,,^ = 28 - 59^ 
RS 


Range = 31 


-60^ 



Note Hoyt estimate of ^otal test reliability = .89; Standard 
error of measurojnent = 2.8?. Mean on total test (of 60 ^ssible) ^ 



r * 4i>.41; and SD ^- B,73. 



o»^t of a jx.>s5>ibie oO item:;. 
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performed to determine whether there were significant differences in , 

performance on the total test due to the sex or grade level of the 

students, , Results of these t;*tests are summarized in Table 11/ There 

was a significant difference in scores due to sex^ with female 

students |6utperforming male students (t-value = -2.10, with a a-'tailed 

probability of /637) • ' 

The t- tests. comparing the three grades resulted in no significant 

differences. 'There were slight mean differences, with the higher grade 
* ■ ■ 

level in each comparison attaining a somewhat higher mean .peA:ent 
^correct score than the lower grade level of the comparison pJir. 

The next analysis of the Vowels Subtest data examined performance 
c total sample on each of the 20 vowel spelling-to-sound corres*- 
pondencos assessed* The total sample data were used because no 
significant grade level differences in performance had been found. 
Table 12 presents a rank ordered listing ^of the 20 correspondences 
within each of the three general categories: short vowels, long 
vowels, and vowel clusters. The Vowels Subtest contained three items 
to assess each of the 20 vowel spelling--to-sound correspondences. 

Performance on the five long vowel correspondences ranged from 
a mean percent correct of 85.7 for long i_, to a mean percent correct 
of 70,3 for .long u. There was a wider range of performance on the 
short vowel correspondences, with performance highest on short u 
(mean percent correct B7.7) and lowest on short o (m(?an percent 
correct 48. 3) . ^ 

Performance on the 10 vowel cluster correspondences ranged from 



Table 11 



Vowels Subtest 



t-Tests^ for Performance Differences 



Due to Sex and Grade 



Variable. 

25 



N Mean 



SD ^ SE 



t-Value . df 



2*Tailed 
probability ' 



Male 



88 ,i4^6"- .156 
i 



Female lof\ .7941 .133 



.017 



.013 



r 



.037 



Grade 3 



92 • .7585 .165 .017 



Grade 4 65 ' .7808 .118 



Grado 4 



- .99 154.99 



.015 



65 .7808 .118 .015^ 



.73 57.37 



33 .8010 .134 .023 



326 



.466 



Grade 3 92 -.7585 .165 .017 



r,rade.„ 5 



-1.46 



33 .8010 .134 .023 

■ — =s^^ 



69.08 



.148 



Significantly different at £ £ .05 level, 
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^ Table 12 ' 
Rank Ordered List of Performance Within 

f 

Categories for the 20 Vowel Correspondences 



Co^espondence Mean^ correct 



vowel s 



u 




• 87.7 


a 




86.3 


i 




75.0 


o 




70.7 


. o 


Long vowels 


48.3 


X 


• 


85.7 


e 


* 


83.0 


a 




73.7 


o 




72.0 


u 


Vowel clusters 


70.3 


ay 


a-s /a/ 


94.3 


ee 


as /e/ 


93.7 


ea 


as /e/ 


91.7 


oo 


as /u/ 


87.0 


ow 


as /ou/ 


84.3 


ou 


as /ou/ 


80.3 


ow 


as /o/ 


73.0 


ai 


as /a/ 


68.0 


au 


as /aw/ 


67.7 


ea 


C.3 /e/ 


54.7 



53 



54 

94*3 moan percent correct on a;|^ as long a, to 54*7 mean percent 
correct on ea as short e. These differences in performance on 
correspondences will be discussed more fully below when the analysis 
of error patterns and specif icd terns are described • 

A series of t-test comparisons were made to determine whether 
there were significant differences in performance among the three 
categories — short vowels, long vowels, and vowel clusters. Results 

• * 

are summarized in Table 13. Performance was significantly different 
^ among the three categories at the £5-05 level. As indicated in the 
table, performance was highest on vowel clusters and lowest on short 
vowels. A review of the data on the individual correspondences shown 
in Table 12 indicates that the low performance on the short o corres- 
IX)ndence (mean percent correct = 48*3) lowered the overall mean for 
ijie short vowels category. ' The vowel clusters category, on the other 
hand, was inflated by three correspondences (ea as long e, ee as long 
o, and .Vj^ as long a) where performance topped 90%, and thus resulted 
in a higher overall mean for that category. 

To understand why performance was so low on the short o corres- 

% 

tx.->n(lonco, wo reviewed oitom analyses J^r the three items assessing short 

An analy:.is of the toil selection* for the total sample on these 
thrt^'C items is prui-^t^nted in Figure 3. 

For oACh item as'^cs5;inq short o, the children were presented 
with a target synthetic word constructed to yield the short' o pronun- 
ciation. To the right of the target word were four picture response 
choict-vq. One picture had a name that contained a sound acoustically 
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Table 13 

t^-Tests for Performance Differences 
Due to Vowel Category 



Variable 



N Mean SD 



2~Tailed 

SE t-Value df^ probability 



Long vowels 



.7691 .195 .014 



Short vowels 



190 



2.57* 189 



.7358 .184 \Q13 



.011 



Long vowels 



.7691 .195 .014 



190 



-2.42* 189 



.016 



Vowel clusters 



046 .145 .011 



thort vowels 



7358 .184 .013 



190 



-5.49* ■ 189 



.000 



Vowel clusters 



.7946 .145 .011 



Significantly different at £ £ <:05 level. 



« 



15.8% 
(book) 



51.6% 
(knot) 



28.9% 
(rope) 



2.1% 
(dresS) 



stom 



o. 3% 




57.41, 
(bo. e) 




35,3% 
(knob) 




.. 5% 
(wig) 



yosh 




57. 'n 

(mup) 




01 
(leaf) 




6. 6% 
(hoo];) 




33.2% 

(boat) 



•iqute J. Item analysis of the throo items assessing short o 
Lthowinq I'Uicont of .^tudont.s s<a^7cting responses. 
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close ^to the short o (oo as in book ) ♦ Another picture had a naine^t>iat 
contained the long sound of o (as in rope ) . /A* third picture haa a 
• me that containe4 a vowel sound that was neither acoustically , close 
to the sound of short o nor visually close to the letter o (such as 
short e as in dress ) . The fourth picture had' a name that contained 
the correct sound, a short o (as in knot ) . A close inspection of the 
errors made by students on the three s >rt-o items reveals that when | 
students failed to correctly pronounce the vowel as a short o_ in the 
target synthetic word, they typically chose the response choice with 
the long o. Overall, it appears that students who made errors did not 
randomly guess — if this had been the case, a much higher percentage 
or children would have selected the response choice that was neither 
acoustically close nor visually clo^?e to the target spelling-to-^ ^ ' 
^ sound correspondence ( dress) > Instead, students who made errors on 
short o items tended to choose the picture name containing ' the other 
common sound correspondence for the letter o, the long o. "This was 
trup even wiion th® picture name had a long o sound that was spelled* 
differently than the vowel of the target word (as in boat , where the 
long o sound 'is designated by oa) . It is interesting to note that the 
It^ss frequent sound /oo/ (as in hood) was not often selected, even 
thouqh this sound, like the long o contain!:: the letter Ot 

Performance on vowel cluster items was generally high, except 

c 

for^thc thrcc'^items assessing ea as short e. Performance on items' 
assessing ea as long e, however, was high. .This discrepancy may 
reflect a familiarity factor, because the frequency of ea as long e 
(294) is more than twice as high as the frequency of ea as short e (135) 



Table 14 presents the results of analysis of students* errors 
on tho Vowels Subtest according to foil categories. As described xn 
detail in the Stimulus section of 'this report, foil creation for the 
Vowels Subtest was governed by, specific criteria. In addition to a 
Correct response choice/ an 'item, had three distractors, . each containing 
a vowtfi corresiondence in a picture name that-was (1) Acoustically Close 
to the target vowel corre pondence, (2) Visually XTlose to the target 
vowtil, or (3) Neither Acoustically Close Nor Visually Close (Neither) 
to the target vowel. In some .ca^es, the acoustic and visual dis tractors 
overlapped. When this occurred, a given test item might have one or 
even two response choices that contained both visual and auditory 
simil^irities to the target vowel correspondence. In considering the 
error analysis presented in Table 14, the reader is cautioned against 
■drawing conclusions about this special "Both Acoustically and Visually 
Close" artifact. 

The valuos ..in Table 14 were obtained in the follpw^ng manner: 
Numbers of students selecting pa^ Mcular distractor types were summed 
av-rotis all test items where that distractor type was offered, and 
then divided by the number of items containing that distractor type, 
to obtain a mean percent of students selecting a particular foil or 
distractor. This procedure was carried out separately for the three 
general categoric^ of test items; short vowels, long vowels^ and 
Vowel clusters. Inspection of these mean percent figures indicates 
an interesting pattern of incorrect responses. Across all three 
categories of vowels, students chose the Both Acoustically and Visually 
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Table 14 

Error Analysis l\y Vowel * Category and Foil Type 
(Average Percent of Subjects (N'^ 189) Selecting an 
Incorrect Response Choice by Vpwel Category) 



Foil Type 



Vowel 


Visually- 


Acoustically 




Bofh 'acoustically close 


category 


close 


close 


Neither 

ir^ . ^ 


and visually close 


Short vowels 


28.3 


3.9 


2.0 


44.6 


Ijonq vowels 


35.2 


7.9 


1.8 


17.6 s ^ 


Clusters 


18.1 


« 9.3 


4.0 

1 


20.7 


Total test 


23.6 


.7.2 


2.9 ' 


^ 25*3 






* 




• * 



* * 

Close and the Visually Close response choices far more often than tliey 
chose the Acoustically Close or the Neither res£x^nse choices. 

To understand this error pattern, which was consistent across 
ail three vowel categories r it is helpful to review the exact nature 
of these foils and the criteria governing their selection. For the 
Visually Close response choice, we decided to use pictures whose names 
.contained the same vowel letter as in the target „ synthetic word (orr 
for. clusters^ one of the t\;o vowel letters in the target cluster)* 
In the distractor name, however, the letter would correspond to a 
different sound* For example, if short a were the tar^t sound, the"^ 
Viiiua 1 ly . Close response choice might be a picture of a cave, A child 
usiuq a visual or spelling strategy might select the picture *of a cave , 
because cave contains the same letter a_ that is in the target ■ 
synthetic word. On the other hand, if the student was not familiar 
with the rules governing pronunciation of the short a in the target 
i/nt p.et iv* word .ind tpn^rfnre frorK^uncod the vowel sound as lonq*a, 
^ave would be a logical ra^ponse* Both of these approaches could have 

r : ■ . . 

led i':tudents tos^ select -the Visually Clone response choice cave and 

contributed toward making the Visually Close ^and the Both Acoustically 

and Visual ly^'Clrose resi>onse choices the most popular distractors when 

f ■ 

i^rn>r>; wen* 'made. 

Because- it is not .^^possih le to dct'^rmino whicli features of t he 
Vi^^ually C.Uvne and the Both Acoustically and Visually Close response 
-hoices led students to choose these responses, conclusions cannot be 
drawn as to the relative strengthf^ of the vi?.:.ual versus the acoustic 
features wTthui th(\^^,e' foilr;. It is reasonahU* to say, however, that 
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children who failed to co^rr^rtly decide taraet correspondences appeared 
to have been strategic, rather than random, in their selection of 
response choices. 

Three additional analyses of the raw score data of. the Vowels 
Subtest were performed. First, data were analyzed to detormine whether 
Items ending in a voiced or a voiceless consonant affect;ed students'* . 
performance on items assessing vowels in medial position, |Becaus^e 
voiced con-sonant endings generally lengthen the duration of the 



preceding vowel sound, such endings might enhance students' perception 
of vowel sounds and thus skew performance. This .v^as not"' the cas*^ in 



the Vowels Subtest, however. Me^n performance scores for^ items con- 

taining all voiced consonant endings were nearly identical to mean 

Scores 'for items containing all voiceless consonant endings. 

A second analysis was performed to determine whether performance 

would differ on it^ms where the spelling of the vowel sound in the 

name of the correct picture differed from the vowel spelling in the 

target synthetic word, versus those items where the spelling was 

identical for the vowel sound in the picture and in the target synthetic 

» * 

word. Mcon percent correct on items representing these two cases 

differed. Iteir^ with identical spellings had a mean percent correct 

of 81.1, whereas items with different vowel spellings had a mean 

percent correct of 71,3. Because vowel correspondences with relatively 

smaller frequencies were somewhat over-represented by items that 

» 

were spelled differently, however, this mean percent correct discrepancy 
wa,s not considered important. ■ 
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Tht* third analysih; of thtt Vowels .Subtest, data involved sc:4>ruH 
fc>Ih-ctf?a trom a sui^ut't ot the total tuimple. Korty-two ut* the 190 
children (22%) in the total sample' were randomly selected for indivi- 
dual productive testing on two oral reading tasks • The purpose was 
to obtain information on the concurrent validity of the written 
Vowels Subtest. The question of interest was whether the group 
administered written test was, in fact, sensitive to t^he kinds of 
nliotuc errors on vowqIs that students are likely to make in a typical - 
readincj situation. 

Children participating in the oral tasks were firsi asked to read 
aloud a list of the 60 synthetic words used on the written Vowels 
.>ubte ^t, and tiK^ir productive terrors on Larqet corresix:>ndences were 
noted by examiners. The children were next instructed to read aloud 
* a 347-word poem whxch included several words for eact^^of the 20 spelling- 
•to-sound correspondences assessed in the written t.est. Again^ errors 
y - on tarqet crorrespondences were recorded. ^ 

t 

Results 'of the error analysis 6n the or^l testing data are pre^* 
irr.tp:! in Table 15. Examination of the summary data in Table 15 
mdicatr:; that student^s made nearly three times as many errors on 'the. 

written ttv^t a.^ on the {.>oc^m and ri^Jriy three times as many err-^rs on 

t1 ^ 



the synthetic word list as on tlw^poem. It should be noted that t!;ie 
f'oem contained or\ly words *which would be well known to students inlthe, 

• ^ f i 

^r.\\^^ li*vt>L^ tested* The- combination of recognition of the pqem's 
worris ar^ r>ight words and the tenefitt reading words in context 
probably ac?countr> for Iho higher perforfnance on the oral reading of 



7' 
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Table 15 



Summary Data orA Oral Reading Tasks and 



Vowels Subtest Across Grades 



(N ^ 42) 



Oral reading tasks 



Poem 



Synthetic worfl list 



Vowels 
Subtest 



f students 



Number of students 
maJ^ing phonics 
errors 

Total number of^^ 
. errors made 

% of Agreement 
\ with Vowels 
Subtest^ • ' 



27 



137 



41 .6 



42 



39 



398 



52 



42 



41 



465 



' 'i tiKj \'ercentd<je ot agreement was calculated by determining the 
ratio of a Student's errors common to the Synthetic Word List and 
Written Test over the Total Number of that student's errors made on 
the Synthetic Word List alone. For example. 



% Agreement for Synthetic Word Li^t - 



Number of errors commox> to Syn- 
thetic Word L^. t> and Written Test 

Total Number of Synthetic Word - 
List Errors 



Inc/ividual percentage of agreement scorQs were then summed across sub- 
jects. The same procedure was used to calculate the percentage of 



agreement for the Poem ^nd the Wi;itten Test errors. 
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the {M.5em. The porcentaqe of agreomont between the £>oem and the written 

tc:it, and between the nynthetic word List, and the written test, how 

tivur, art; not discf oi)ant . Even though Rtudonts w^ro losn likely to 

mwike errors on tarqet vowel correspondences while reading the poem, * ' 

the errors they did make wai|e also made o;r^th^ written test an ^ . , 

average of 41'l6'^i of the time. The percentage of agreement f^r errors 

made 'on the synthetic word list and on the written l^es^ was ^onl^r-slightly 

higher,^ with errors on vowel correspondences agreeing ^oa the average 

of 52,3% of the time. The percentage of agreement was cai^ulated by 

using the ratio presented in T^ble 15. Although there may be alt^nate 

^ways .to calculate agreement, the ratio used was basqd on the considera- 

tion that the risk would be greater from an educational vjLewt:)oint if 

the written t^st were not sensitive to possi^ble confusions on phonics 
• * 
generalizations (i.e.^ if it pointed»out relatively few areas af 

^ . ■ ' *« 

possible problems) • The risk would be less if the test were relatively 

oversensitive to possible confusion areas (i.el, if it identified more 

areas of possible . problems) which the classr.oa[n teacher could later 

rule out as not troublesome through informal checks. 

\ 

Discussion 

The most interesting results of the Vowels Subtest relate to the 
iii.-i lysis of error patterns made when students had not mastered a 

corresnondenco - L^ven when making errors, clfildren appeared to have 

bo^^n str.itequ: in sc?iectiri'j tne^ir ror,[xin".^e choices- 
Several issues that were of concern during item construction were 

analyzed. Items ending i-n voiced versus voiceless consonants were 
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"evaluated to determine whether such consonant manipulation would 
at toe t Vowel in*rceptlon, makuuj corLain itt ms (namciy, those ending 

0 

in voiced conaon^fnts) easier^^^ perceive than others. In "fact, no 
such effect- was obtained. We decided^ however^ to maintain the con- 
sistency within items of having the target synthetic word and the 
four picture names end in either all voiceless or all voiced consonants* 

The spelling of the target vowel correspondences in the synthetic 
words versus the spelling for the vowel sound in the correcft response 
picture name was also examined* Berformance was the same for items 
with identical spellings and items with discrepant spellings* 

Although much care was taken to ensure the distinctiveness of 
each response foil, overlapping features were sometimes unavoidable . 
This is due to the large number of sounds generated by ^relatively few 
vowel letters and the similarities of many of the vowel sounds • While 
it is clear that the children chose these overlapping foils in fairly 
high percentages^ the strategies they used in their selections cannot 
bo explained with certainty. It can -be speculated that the relatively 
high numbers of students selecting the Visually Close and the Botli 
Acoustically and Visually 'Close response choices represent a group that 
when they mispronounce a' vowel, do ^o by saying the vowel's most 
frequent sound counterpart. In addition, some pupils may mentally 
"spell" the picture names of the response foils, and then "match" the 
vowel spelling of the picture name to that found in the target synthetic 
word* While neither explanation is clearly dictated by data, it is 
certain that students who failed to master the 20 vowel spelling--to- 
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Gouud correspondencer^ used some kind of strategic approach in responding 
to itoms. 

Results of the error analysis involving the oral testing indicated 
thvit students made jnore than three times as many errors on the written 
tost as on the loem and nearly tnroe times as many errors on the syn- 
thetic word list as on the poem. The easy vocabulary of the poem, as 
well as the advantage of being able to read the words in context, 
probably account for this discrepancy. Of more interest was the rela- 
tively even percentage of agreement botwot»n the kinds of phonics errors 
made on ti^ poem and the written test and on the synthetic word list 
and the written test (41.6 and 52.8%, respectively). 

The percentage of ac,reement was calculated by dividing the errors 

In common on the oral and written tasks by the total number of errors 

made on the oral task. Although there are alternate ways to calculate 

agreement, thi^ ratio was used because it would be the most sensitive 

to tossibie confusions in phonic generalizations. The Phonics Test 

« 

v^^iaj/^'be of greater diagnostic value if it identifies all possible 
phonics problems (which, if necessary, could be confirmed through an 
informal check) than if the test is not sensitive to possible errors 
.^nd is therefor*} not thorough in pointing out all of a student's phonic 
weaknt^i>ses . 

sum:4ary and futuio: directions 

Ker,ults of item. analyses from the administration of the spring 
1^>79 Phonics Test suggested some interesting spec Lions about the 
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nature of phonics processing. Overall, P^rT nnance on both the Conso- 
nants ando Vowels Subtests was high. The results of the Consonants 
study indicated that by third grade children have mastered most of 
the frequently occurrir^g letter-sound correspondences in our language. 
Exceptions included items assessing two of the digraphs .jj gh and • 
Children who made errors on these tended to select distractors con- 
taining either (for the £h digraph) or (for the digraph) — ^ 
that is, the first of the two letters comprising each digraph. Per- 
formance also dropped on the three single-letter consonants which 
have other common sound correspondences (c^, and g[) . Predictably, 
when children made errors on items assessing these letters with variant 
correspondences r they selected responses containing the other common 
sound for each letter (i.e., 2.^^ /j/ ii?stead o1^ as /q/ , c as /s/ 
instead of as /k/, and as /z/ instead of as^ /s/) . 

In general, performance was highest on consonant clusters (mean 
- < rv entvi^a- - ■•.^7.'>4), :u-c'(nid hiqhest sinqlo-lottor consonants (mean 
I-crccnta^c = 90. 75), and lowest on consonant digraphs (mean percentage 

^^.^), Hutwecn-cjrano difforencor. wore not significant, with third, 
fourth, and fifth grade pupils averaging 91.3, 91.3, and 93.3% correct, 
respectively. For all grades, performance was h.igher on consonants 
assessed in initial position than on those assessed in final position. 

Aqreement oh the Rinds of phonics errors made orally and on the written 
« 

test was 27.8% for the poem and 26.9% for the , synthetic word list. 

In the Vowel| Subtest mean performance, while not as high as in 
the Consonants Subtest, still exceeded 75% for all three grades. 



There:*, were no siqnificant differences between grades, although sighi- 
ficaat sex differences wc-re obtained — with girls outperforming boys 
across the three grade levels. 

A series of t^-test comparisons revealed that there were signi- 
ficant differences in performance among the three categories of vowel 
it/ims — short vowels, long vowels, and vowel clusters. Performance 
was highest on vowel clusters {mean score 7^,5%) and lowest on short 
vowels (mean score 73.6%) . • ' ^ 

An analysis of the kinds of errors made on the Vowels Subtest 
revealed that, in general, children who made errors were strategic and 
selected response cho . . cs that wure ciithor acoustically or Visually 
close to the target letter (s) or sound, or which represented another 
conunon »^ound correspondence for the target letter. 

Finally, analyses designed to reveal possible sources of error 
relating to the co;istruction of the Vowels Subtest were performed. 
Tht'St^ analyses involved comparing (1) items ending in voiced consonants 

4 

vorsus itt»m:i ending in voicelesia consonants, (2) items where the spelling 
of a target sound matched the spelling of the name of the correct 
rer>pon:;e picture with items in which the spelling of the target souiid 
in tlu^ synthetic word differed .from the spelling of the sound in the 
correct picture name, and (3) a subsample of children's performance 
on two oral reading tasks with performance on the written Vowels 
Subtest . 

The above analyses yielded three major conclusions. First, the 
children did not {perform differentially on vowel items that ended in 
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all voiced Consonants versus items that ended in all voiceless conso- 
nants, Secofadr spel^ling differences of vowel sounds did affect per- 
formance. Many relatively unfamiliar correspondexices were over^ 
r^resenttid among thd spelled differently*' items » however, tlius 
clouding interpretation Of this finding. Finally, far fewer phonics 
errors wl^rd made ojpi the oral task with the poem than on either the ^ 
oral task with thle synthetic word list or the written test. Neverthe- 
lusi>/*»the percentage of agreement between each oral task and the 
written te^st was extremely close — 41.6% for the poem and the written 
test^ and 52.8% for the synthetic word list and the written test. 

,As \ result of these analyses, sever il changes are being c6nsidered 

for the winter 1979-80 .Phonics Test. One issue of primary, interest 

i 

is the relative contribution of children's auditory and visual strategies 
*in selecting response choices. Because the Acoustically Close and the 
Visually Close response choices overlapped in a large number of items, 
a cloar-cut analysis of error patterns across the entire test was 
difficult^ 

In an attempt to eliminate some of the overlapping between response 
categories, the rules, for creating r<^sponse choices will be revised. 
As in the spring 1979 version of the test, all items will have four 
response choices,, including a Correct response choice and a NeiUier 
response choice. The remaining two response choices will be from the 
•following three categories: Acoustically Close ^ased on the Miller 
and Nicely confusion matrices for consonants, and the Peterson and 
Eiarney confusion matrix for vowels) , Visually Close {based on the 
Bo\ima confusion matrix for lower-case letters) , and the Other Common 
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■'.ouiul of the Tarqet CorrGspoiidonce (for example, lonq a if the target 

corrosjionUence is short a, and c as /s/ if the target correspondence 

i« £ ^"^^ A/) • J'or some items, however, an ovorlappirig between 

response choice categories will .be unavoidable^ as, for example, in 

the c.i.^;e of Tfiero is no Other Common Sound Correspondence for m 

arui, LhtL.'? v^t\u v.- , the* rt.:S[>oni;e choiuo:. will be trom tiio two cateqorien 

.)u;.t iciily Close and. Visually Close. The sound that is closest 

aroust xcaliy to the target sound /m/ is /n/. Similarly, the letter 

r; I ■ ihv letter th^it is visu^iliy closest to the tarqet letter m, 

». — 

^M^TiiN', t p.o t\ircj«/t vH>rre;ipondtwice in the picture names in both response 
\:hoices will inevitably overlap. 

To more cleanly delineate the relative contributions of students' 
auditoty and vi:3ual strategies^ consideration is being given to 
cxamininq only those 'items in whica none of the response choices over- 

wnoii analysing the data t^r t.-cn.r fMt^orns. kesf-onse Coil.s for 
thxi^ analysis will bo from the categories of Acoustically' Clo^e , 
^Visually Close, Otiier Common Sound of -the Target Correspondence / ai;d 

A i^ocond issue involves assessing younger children's performance , 
ihi: Piionic:; Te^^t. Because overall perf dnnanpe on both the Vowels 
arul \.\')n:;wnn!it Subtc'st " was exlremt;ly high, and becausi? we arc? inter- 
♦ "'^f^'d in vjainir^g a better understanding of the developmental nature . 
•»f vhoaicTs skills acr^u isiL ion , students in tht» primary grader, will 
t'articipate in tlie next administration of the tests. The spring 1979 
rr:.nu^-:; To.^.t Wcts admini stirred to pupils in third, fourth, and fiftit 
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qradt^s? the revised Phonics Test will be aclministered to second and 
third cjraJe children in winter lOTO^-SO. 

Another issue raised during test adiuinistratioft concerned the 
effect that tn'i^snomed pictures might have had on children's performance 
lirt\ile the Children participated in the Piccure Naming Exercise 
iinmediatoiy prior to the actual administration of the tebi, there was 
snill uncertainty as. to whether children recalled or used the intended 
labels for the pictures. Moreover^ the Picture Naming Exercise, with 
its separate set of directions r required an additional phase of test 
administration. Therefore, in the next administration of the tesc 

i 

the examiner will read aloud the names of the picture response choices 
to students. This alteration in procedure will eliminate the need 
for the Picture Naminq .Kxercii^e and will control for consistency in 
Iab»?ling pictures. An additional benefit is that student^ will be 
paced throughout Uu. test. Because students must still read (decide) 
the target synthetic word themselves, the decoding nature of the task 
will be preserved. 

The most significant issue concerning changes in the next version 
of the Phonics Test . involves the assessment of more letter-sound 
coi;respondences. To make the test more global/ without adding 
^substantial time to the tost^ the nu^nber of items used to assess each 
rrorrespcmdence will be decre^ed fx on. three or four to two. For 
t^xampLe, on the spring 1979 Phonics Test, 15 singles-letter consona-t 
correspondences were randomly selected for assessment from a category' 
total of 23. On the new version of the Phonics Test, in which there 
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will ht* only two items per correspondence, all 23 :^ingle-letter con- 
Honants can be assessed with only 46 items---five items fewer than on 
thi^ t .4rli*^r veriiioa. Table lb present?; a breakdown of the number of 

asifessfd in the 'sprin^ 1979 Phonics Test for each consonaar*^d 
vowel catoqory, .-*nd of the ,>roiected number of items being coni^dered 
icr inclu::ior in the winter 1979'-80 Phonics Tt.-st. As Table 16 
iridicatesp the new version will assess 73% more correspondences in 
.*>Ti 1 V 1 \ no re, i terns . 

In winter 1979--B0, the revised version of the Phonics Test will 
h.-^ pilot-tested on several classef^ of urimary. school children, ^ 
AptToprlate revisions will be made following analysis of the data. 

The Phonics Test is one of throe major comi^nents of a Word 

I.if ntif ication Test battery. The total battery will be administered 

m April 1050 to several hundred elementary school chlJJi-vn. The 

rtv\.Jin<j subtest uf the Metropolitan '^ch i r-vement Tests (Uaror.t et al,-, 

l'>75)), a standardized measure of comprehension, will also be adminis- 

tt?red m order to obtain correlationary information. All-ways 

correlations will be run between each ^/f th^.- components (Pli^Mi-js, 

Structure., ^nd Context) of the total Word Identification Test battery 

\ 

iiid tlui. comprehension sections of the Metropolitan Achievement Tests, 

We believe that the information gained through the administration 
of the test battery will {provide insights about the relationships of 
the various components of word identification to comprehension. 
Ultimately, this knowledge will have i>ractical api:>lication for instruc- 
tion in the classroom* 



Table Ih 



' Comparison Between the Spring 1979 Phonics Test and 



the Proposed Revised Phoni 



of CorresrADndences Assessed and Nuiube 



of Items per Category 



icin Test for Nunjbe 



Consonan t s Subtest 

Sinqlo- lotter 
consonants 



Spring 1979 Phonics Test 



Proposed Revised Phonics Test 



No. of corrG- No. of items No. of corre- No. of items 
spondences (3 or 4 per spondences (2 per 

assessed correspondence} assessed correspondence) 
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51 



23 



46. 



Consonant 
clusters 



15 



21 



42 



Consonant 
diqr i{>h.'". 
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Vow V 1 s Sub t e ^ L 



Ix>iiq vow«.'!. s 



Short vowels 



15 
15 



5 



10 



Other sinalf- 
letter vowels 

Vo wo 1 clusters 
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20 
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60 



t 
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29 



8 
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Appendix A 



A page from the Picture Naming booklet 
for the Consonants Subtest 




Appendix B 

Th*» subi(^ct'>; copy of the first page of the word list from 

the oral reading task for the Consonants Subtest [ 



1 

The student's copy of the poem from the oral reading task ^ 
for the Consonants Subtest 
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Below iu a list of "m.Kk'-up" words;. PU/ase road each word aloud. 



1. cade 



2* 



vode 



dem 



4. troon 



•■> . we X p 
6. spcat 



chor t 

8. gade 

^i. spafe 

10. ^iid 

11. "ciote 

1 . 1 S p 

15. brask 

14. cobe 



/ 



15. 

lb. 

17. 



1^ . 



20 . 



22 . 



24. 



2»> . 



thelp 

wift 
joast 



1 « , wame 



tasp 
cbone 
bratG 
cluf f 



2 K CUZZ 



28. 



cete 
traf f 
br oop 

goap 
baff 



*'If You Wcrcn* L .ou" 



Have you ever thought of things 
From ^^^i^ferent point of view? 
Of how life would be 
1 f you • weron * L /ou? 



Would you like to play a game with me? 
Just for fun? 

Let's pretend we're something different, 
Here's how the game is done. 

If you were a star shining in space 
YouM never have to comb your hair 
Or wash your hands and face • 

If you were a king, v^ery long ago 
You could never ever chew gum 
Or watch a TV show. 



If /ou wore a tree in ci field of flowers, 
You' d have no use for <^locks^ or k^tes 
Or bathtub toys or towers. 



9:j 



If you w.ere a bride w\th a train of silk. 
You miqht pose for a photograph 
While drinking chocolate milk. 

* » 
If you were a spider 
Living in a rug. 
You might br.ild a giant web 
To tr?ap the biggest bag. 

If you were a clown with a bright red nose 
You might jump through a druni 
Or spread jam with your toes. 

If you wore a book on birds and fishes. 
One page might tell why both of these 
ThinK worms make tasty dishes . 

But I am and you are you. 
And so my friend 
Our game i s through • 



Appendix C 

A page from the Picture Naming booklet 
for the Vowols Subtest 
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Appendix D ^ 

The subit ct's .copy of the first pa^^e of the word .list from 
the oral reading task for the Vowels Subtest 



The student's copy of th4 poem from the oral reading task 

for' the Vowels Subtest 
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Below is a list^of ''made-up" words* Please .read each. word aloud. ^ 



2.. shuff. . \ 1 X6. treen 



.A 



-4 « 

I 



— ^ 
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. *3 . : prown • 17 . jEr.eam 

4. stake * . - -18. ' yede 

. • • • 

5,. roove >; ,• .],9... ; bl-ute 

6. ' drave , ' • 20. trowse ' - 

7\ • floud " I 21. ,veem _j \ " 

X • 8. naud ' , • 22. maith 

— * 

9- neek ,23. sp«sU 

/■^ ... . . . 

10 : p.rube ^ ,. ^4." vede .. - 

11. _ teap , 25. bloff - - 

12. vad ■ • 26. zope 

13. d\iss • 27. taun 



* 14. fide - ,, • • 25. zoon • ■ t!' 



• * 
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Gabe and I are the best x)f friends. - r ^ 
Through boom- and bust we-'-ll-be- fx lends- ta4Uie-'^d^ 
But there was- one day when we almost parted V 

story 

c ■ 



I'll tell you the story. Here's how it all started., . . 



We ^ere off on a journey to« find the mouth ' 

• ' ' ' ' 

Of the Blue Moon River (it's'wa^ down south). . 

On a nice June day we were packing our. jeep. 

We'd had breakfast early .and had finished our "sleep. 



When suddenly I paw what I thought,, was a crow 
Stealing Gabe^ old red hat from our campsite below. 
That brainy old bird took the hat? in^ its beak 
And flew over some trees with it that oldv, sneak i 

Since Gabe had just gQhe to the lake for, sojne water, 
I ran through the trees on the trail of the robber,' 
I'd find where he'd gone and be .back in a minut^. 
And give Gabe his hat before he had missed it. 

{At least those were the thoughts-' that I thought at the s 
How mistaken I was gives my- story .its theme.) 
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The old crow had flown with the hat to his nest, 

• . • , ^ • < ' 

And i thougHt "X could see- tTiin/ shredding*' ±t^"cn:es1r ; ; 

I'd sat down on ^ rock to come -up with. a plan 

I'^Ihen I heard Gabe>shouting * so b&ck I ran. • 

Gabe was red in the face and mad as a. hen. 

He demandecl to know where the heck I had been. 

Seems. he*d finished the chores, all the cleanup and packing. 

And he yelled that when work called I always 'wa&v* lacking. - 



Well I tried to explain" 'bout his hat and the crow, 
But his face, it got taut and his a|iger ^id grow. . . 
Since his red hat v*as sitting on top of his head, 
He just naturally thought I ,was lying instead.. 



Now I still don't know what it wms that crow took, 

V 

•But" it "tai^ght me to give things a seccinij,, hard look.. 
If I thirlv.I*ve seen one thing, I'll. look twice again, 
N 'Cause a red hat that isn't can lose you a friend. 



